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data  from  the  USAIS  ACTR  were  not  successful  in  predicting  the  criterion  of 
field  leadership.  The  OERs  showed  a  significant  correlation  with  the  field 
leadership  ratings  and  as  would  be  expected  showed  a  similar  lack  of  relation¬ 
ship  to  the  ACTR  data.  Only  the  leadership  course  grades  were  fairly  well 
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FOREWORD 


The  research  reported  here  was  performed  by  the  Fort  Benning  Field 
Unit  of  the  Army  Research  Institute.  The  research  is  part  of  an  on-going 
program  directed  toward  developing  cost-effective  methods  for  leadership 
assessment  and  training.  This  program  includes  research  on  multiple 
aspects  of  the  design,  development,  evaluation  and  integration  of  cost- 
effective  leadership  training  systems  for  the  US  Army. 

This  report  describes  a  validation  study  of  the  US  Army  Infantry 
School  (USAIS)  Assessment  Center  (ACTR)  which  tested  over  400  junior 
officers  and  NCOs  during  the  period  July  1973  to  December  1974.  The  Army 
Research  Institute  correlated  assessee  data  from  the  ACTR  with  field 
ratings  of  leadership  obtained  on  the  assessees  6—  and  18-months  following 
their  assignment  to  new  duty  stations,  with  Officer  Evaluation  Report 
ratings  and  with  USAIS  Leadership  Course  performance  of  assessees.  This 
was  done  to  identify  ACTR  exercises  which  accurately  predict  future  leader¬ 
ship  performance.  Results  indicated  only  marginal  utility  of  the  ACTR 
for  such  predictions. 

This  project  was  conducted  during  FY77  and  FY78  as  part  of  Army  RDTE 
Project  2Q162717A766,  Manpower  Systems  Management.  The  research  was 
directly  responsive  to  the  needs  of  USAIS  and  TRADOC. 
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BRIEF 


Requirement : 

This  research  evaluated  an  assessment  center  which  the  U.S.  Army  In¬ 
fantry  School  (USAIS)  conducted  in  1973-1974.  This  assessment  center  tested 
408  junior  officers  and  NCOs  who  were  students  in  USAIS  leadership  courses. 
The  primary  research  questions  were  whether  the  ACTR  predicted  future  lead¬ 
ership  performance  or  attrition  in  the  Branch  Immaterial  Officer  Candidate 
Course  (BIOCC)  and  whether  the  ACTR  testing  and  feedback  provided  useful 
leadership  development. 


Procedure: 

The  ACTR  provided  3  days  of  intensive  testing  of  assesSees.  This  in¬ 
cluded  seven  job-task  simulations,  an  interview,  paper-and-pencil  performance 
tests,  and  self-description  instruments.  Job-task  simulations  were  designed 
to  accurately  reflect  real  combat  and  garrison  job  requirements.  Highly 
trained  assessors  made  performance  ratings  on  10  different  leadership  dimen¬ 
sions.  In  the  follow-up  research  on  the  ACTR,  a  leadership  performance  rat¬ 
ing  form  (LPRF)  was  used  to  obtain  field  leadership  ratings  from  superiors, 
peers,  and  subordinates  of  the  assessees  at  6  and  18  months  after  the  as- 
sessee  graduated  and  were  assigned  to  a  new  unit.  In  addition,  leadership 
course  grades  were  obtained  for  assessees  and  Officer  Evaluation  Reports 
(OERs)  for  officers. 


Findings : 

Both  LPRF  ratings  and  ACTR  measures  were  highly  consistent,  but  the 
ACTR  data  predicted  the  LPRF  ratings  poorly.  ACTR  self-descriptions  pro¬ 
vided  the  best  field  leadership  predictions  and  required  the  least  assessor 
and  assessee  time.  The  correlations  between  the  last  OER  and  four  previous 
OERs  indicated  that  the  OERs  were  consistent,  but  the  OERs  did  not  seem  to 
be  related  to  assessment  center  ratings  either. 

Assessment  center  data,  particularly  from  paper-and-pencil  tests,  did 
predict  end-of-course  grades.  However,  ACTR  measures  were  only  marginally 
predictive  of  Branch  Immaterial  Officer  Candidate  Course  attrition.  In  ad¬ 
dition,  there  were  no  differences  between  assessees  and  a  matched  control 
group  in  the  LPRF  ratings  or  in  course  grades  that  would  have  indicated  im¬ 
provements  resulting  from  attending  the  assessment  center. 

However,  an  end-of-course  questionnaire  indicated  that  assessees  be¬ 
lieved  nearly  unanimously  that  the  ACTR  was  extremely  worthwhile  and  the 
feedback  session  was  highly  informative. 
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Utilization  of  Findings: 

ACTR  data  did  predict  leadership  course  performance  and  would  allow 
selection  of  personnel  who  would  succeed  in  this  academic  leadership  en¬ 
vironment.  Problems  with  the  other  leadership  criteria  (LPRF  ratings  and 
OERs)  probably  account  for  the  failure  of  the  ACTR  data  to  predict  them. 
The  OER  has  already  been  revised  due  to  other  indications  of  its  deficien¬ 
cies.  Researchers  should  be  aware  of  the  possible  problems  with  ratings 
of  leadership  such  as  those  obtained  with  the  LPRF  when  they  seek  criteria 
to  validate  leadership  assessment  techniques  or  leadership  training. 
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ASSESSMENT  CENTER  PREDICTIONS  OF 
SUCCESS,  TRAINING  ATTRITION  AND  DEVELOPMENT  OF 
ARMY  LEADERS 

INTRODUCTION 

A  person  being  assessed  in  an  assessment  center  performs  a  number  of 
tasks  which  are  close  approximations  to  the  tasks  he  will  perform  if 
actually  selected  for  the  job.  Trained  assessors  observe  and  rate  the 
assessee  on  leadership,  management  and/or  other  behaviors  which  are 
critical  to  effective  job  performance.  The  combination  of  accurate 
simulations  of  job  tasks  and  reliable  performance  ratings  has  led  to 
widespread  successful  use  of  assessment  centers  for  selection  and 
promotion  of  personnel  in  private  and  public  organizations.  (Earles  and 
Winn,  1977;  Jaffe  and  Frank, 1976). 

Two  experimental  assessment  centers  have  been  conducted  by  the  Army 
with  the  purpose  of  accurately  measuring  leadership  skills  and  potential. 
The  earlier  was  at  Fort  McClellan,  Alabama  from  1963  to  1965  and  was  known 
as  the  Officer  Evaluation  Center  (OEC).  Nine  hundred  junior  officers 
(grades  01  and  02)  from  different  branches  received  three  days  of 
intensive  testing  on  15  situational  problems  representative  of  officer 
duties  in  combat,  administrative  and  technical  assignments.  Although  a 
validation  of  the  OEC  measures  was  initially  planned  against  "success  in 
combat  and  technical/administrative  assignments"  (Helme,  Willemin  and  Day, 
1971;  Helme,  Willemin  and  Grafton,  1974),  this  was  never  actually 
completed  due  to  the  small  amount  of  data  on  assessees  that  was  obtained 
from  field  settings. 

The  other  experimental  assessment  center  was  conducted  at  the  U.S. 
Army  Infantry  School  (USAIS)  at  Fort  Benning,  Georgia  in  1973  and  1974. 
Leadership  skills  were  assessed  during  an  intensive  three-day  testing 
session  on  more  than  300  junior  officers  and  about  100  NCOs.  Details  on 
this  assessment  center  are  presented  below,  and  in  additional  reports 
(Dyer  and  Hilligoss,  1979;  Smith,  1973;  U.S.  Army  Infantry  School,  1974). 

The  present  report  describes  the  validation  of  the  USAIS  Assessment 
Center.  The  original  criterion  planned  for  this  validation  was  leadership 
ratings  obtained  from  supervisors,  peers  and  subordinates  of  the  assessee 
following  his  assignment  to  an  operational  unit.  However,  additional 
criteria  of  Officer  Evaluation  Report  ratings  and  leadership  course 
performance  also  were  related  to  the  assessment  center  data  and  these 
results  also  are  included  in  this  report.  The  report  al30  describes  the 
effectiveness  of  the  assessment  center  for  predicting  success  in  the 
Branch  Immaterial  Off  .cer  Candidate  Course  (BIOCC)  which  was  formerly 
known  as  the  Officer  Candidate  School.  Still  another  purpose  of  this 
report  is  to  provide  data  on  leadership  development  which  was  expected  to 


be  a  by-product  of  leadership  assessment  in  the  USAIS  Assessment  Center, 
particularly  for  those  assessees  who  received  feedback  on  their 
deficiencies  in  leadership  skills. 

DESCRIPTION  OF  THE  USAIS  ASSESSMENT  CENTER 


BACKGROUND 

In  1971  a  special  Army  study  group  recommended  formation  of  an 
assessment  center  at  the  U.  S.  Army  Infantry  School  (USAIS) ,  Fort  1-  ang, 
Georgia  to  test  the  assessment  center  concept  as  it  might  apply  to 
Army.  More  specifically,  this  pilot  assessment  center  was  to  test 
utility  of  the  concept  for  selection  of  BIOCC  candidates,  to  test  t 
concept  as  a  leadership  development  technique  and  to  determine  the 
feasibility  of  Army-wide  use  of  assessment  centers.  The  ACTR  was 
established  in  late  1972.  Assessees  were  primarily  students  about  >. 
begin  either  the  Infantry  Officer  Advanced  Course  (IOAC),  Infantry  Officer 
Basic  Course  (IOBC),  Branch  Immaterial  Officer  Candidate  Course  (BIOCC)  or 
Advanced  Noncommissioned  Officer  System  (ANCOES).  Actual  assessments 
were  begun  in  July  1 973  and  continued  to  December  1974  when  the  pilot 
center  terminated  on  schedule. 

Follow-up  data  collection  (field  leadership  ratings,  course  performance, 
BIOCC  attrition)  was  carried  out  by  the  Army  Research  Institute  (ARl). 

ASSESSMENT  CENTER  STAFF 

The  Assessment  Center  Staff  consisted  of  a  Command  Group  (including 
Administration),  an  Assessment/ Counseling  Group,  a  Computer  Group  and  an 
Evaluation  Group  (ARl).  ARI,  although  providing  technical  assistance  as 
part  of  the  Assessment  Center  Staff,  remained  an  independent  field  unit. 

The  Command  Group  was  responsible  for  the  development  and  testing  of 
the  assessment  center  concept.  This  group  consisted  of  a  Chief  (COL) , 
Deputy  (LTC),  Administrative  Officer  (MAJ),  Adm/Supply  NCO  (SFC)  and  two 
ARI  secretaries. 

The  Assessment/Counseling  Group  was  responsible  for  the  development 
of  assessment  exercises  and  rating  scales,  exercise  administration, 
behavioral  observations  and  counseling  feedback  sessions.  The  group 
consisted  of  a  Chief  (LTC),  six  Majors,  four  Captains,  six  Sergeants,  and 
one  ARI  secretary.  The  assessor/ counselor  officers  were  selected  by  DA 
using  the  following  criteria:  each  officer  had  to  be  in  a  Combat  Arm  with 
a  recent  tour  in  a  combat  zone.  Each  officer  had  to  have  a  minimum  of  a 
bachelor's  degree  in  one  of  the  Social  Sciences.  Each  enlisted  man  had  to 
hold  a  combat  arms  MOS  and  have  nad  a  recent  tour  in  a  combat  zone. 
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The  Computer  Group  was  responsible  for  data  reduction  and  preparation 
of  summary  statistics  for  feedback  purposes.  The  staff  consisted  of  a 
Chief  (MAJ),  one  CPT  and  two  enlisted  programmers. 

The  Evaluation  Group  (ARI)  was  responsible  for  the  validation 
program.  This  group  provided  technical  advice  and  assistance  also  in 
exercise  development,  questionnaire  writing  and  selection  of  paper  and 
pencil  tests  and  other  instruments.  The  staff  consisted  of  three  civilian 
Research  Psychologists. 

ASSESSOR  TRAINING 

Assessor  training  consisted  of  formal  presentations  of  principles  and 
techniques  of  assessment  by  members  of  the  ARI  Field  Unit,  an  assessment 
workshop  conducted  by  Development  Dimensions,  Inc.,  a  performance 
counseling  workshop  conducted  by  the  U.  S.  Army  Human  Research  Unit  from 
Fort  Bliss,  Texas  and  a  counseling  interview  conducted  by  Baker  Consulting 
Associates . 

In  addition  to  the  formal  training,  assessors  received  informal 
training  in  conjunction  with  the  development  of  each  exercise.  This 
practical  training  was  received  during  the  pilot  testing  of  each  exercise. 
As  each  exercise  was  presented  for  its  initial  test  auministration  (Pilot 
Test),  all  assessors  were  briefed  on  the  purpose,  content  and  evaluative 
techniques  to  be  used.  Subsequent  to  the  administration  of  each  pilot 
test,  assessors  compared  their  individual  ratings  during  a  group  meeting. 
When  significant  rating  differences  occurred  (two  or  three  scale  ratings 
from  the  group  norm)  that  particular  assessor  was  required  to  explain  the 
rationale  for  his  evaluation.  This  method  served  as  a  self-training 
device  for  the  group  by  making  each  assessor  aware  of  a  wider  range  of 
behaviors  available  for  observation.  It  also  assisted  him  in  evaluating 
behaviors  on  the  rating  scales  and  provided  a  means  of  determining  what 
type  of  comments  were  appropriate  on  the  narrative  section  of  each 
exercise.  In  several  exercises  (e.g.  Entry  Interview,  In-Basket 
Interview),  the  group  evaluation  and  comparison  were  made  after  reviewing 
the  exercise  on  video-tape. 

ASSESSMENT  CENTER  EXERCISES 

The  Assessment  Center  Staff  constructed  exercises  and  questionnaires 
to  measure  ten  dimensions  of  leader  behavior.  Leadership  research 
indicated  these  dimensions  to  be  appropriate  for  the  assigned  mission  and 
it  was  believed  these  dimensions  could  be  evaluated  using  the  assessment 
center  concept.  These  dimensions  were  adaptability,  administrative 
skills,  communication  skills,  decision  making,  forcefulness,  mental 
ability,  motivation,  effectiveness  in  an  organizational  leadership  role, 
social  skills  and  supervisory  skills.  In  evaluating  possible  exercises 
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and  exercise  concepts,  a  basic  factor  of  consideration  was  that  the 
exercises  would  place  the  assessees  in  uniquely  different  situations  while 
simultaneously  providing  multiple  opportunities  for  the  evaluation  of  each 
leadership  dimension.  Exercises  were  developed  which  exhibited 
situational  diversity,  military  relevance  and  apparent  potential  for 
eliciting  behaviors  related  to  the  designated  dimensions  (Olmstead, 

Cleary,  Lackey  and  Salter,  1973). 

Leaderless  Group  Discussion 

This  exercise  was  a  combined  individual  and  group  task  in  which  six 
IOAC  assessees  were  assigned  a  mission  to  distribute  year-end  funds 
(resource  allocation)  among  six  representative  directorates.  Each 
asseessee  attempted  to  acquire  a  maximum  amount  for  his  own  directorate  by 
persuading  the  6  man  group  to  decide  in  favor  of  the  position  he 
represented  while  also  acting  as  a  responsible  group  member  in  helping  the 
group  reach  the  best  overall  decision.  For  their  task,  IOBC,  BIOCC  and 
ANCOES  assessees  were  assigned  a  mission  to  select  a  soldier  from  their 
units  to  compete  for  the  Brigade  Soldier  of  the  Month  and  provide  a  rank 
order-of-merit  list  of  the  available  candidates.  All  assesses  received 
the  same  general  task  instructions.  This  exercise  was  designed  to  elicit 
behaviors  associated  with  forcefulness,  persuasiveness,  ability  to 
organize  and  group  interaction.  There  were  three  raters,  nine  rating 
scales,  and  six  peer- ranking  scales.  Time  for  the  exercise  was  120 
minutes . 

Management  Exercise  (Competitive  Stock  Trading  Exercise-"Conglomerate'') 

This  was  an  exercise  divided  into  two  planning  and  two  trading 
periods.  Three  leaderless  six-man  teams  traded  stock,  attempting  to  gain 
control  of  conglomerates  while  blocking  other  teams  from  doing  so.  This 
exercise  was  designed  to  elicit  behaviors  related  to  emergent  leadership, 
aggressiveness  and  social  interaction.  There  were  three  raters,  eight 
rating  scales  and  five  peer-ranking  scales.  Time  was  120  minutes. 

Assigned  Leader  Group  Exercise 

This  was  an  assigned-role  rotating  leader  exercise  conducted  outdoors 
involving  a  team  of  six  assessees.  There  were  six  lanes,  each  with  a 
different  obstacle  to  be  overcome  and  with  a  different  team  member 
assigned  as  leader.  The  exercise  was  designed  to  elicit  emergent 
leadership,  planning  and  organizational  behaviors.  There  were  three 
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raters,  nine  rating  scales  and  four  peer- ranking  scales.  The  IOAC 
assessees  did  not  participate  in  this  exercise.  Time  was  300  minutes. 


Leader  War  Game  (IOAC  only) . 

This  was  an  assigned-role  rotating  leader  exercise  conducted  in  two 
two- hour  sessions.  Teams  of  six  players  engaged  in  cost  effectiveness 
analysis  in  a  military  force  planning  environment  (arms  purchase, 
modification  and  deployment  against  an  enemy  group).  Total  costs,  R  and 
D,  intelligence  acquisition,  balanced  offensive/defensive  forces  were  all 
considered  under  a  limited  budget  and  time  constraints.  This  exercise  was 
designed  to  elicit  organizational  and  leadership  behaviors.  There  were 
three  raters,  nine  rating  scales  and  five  peer- ranking  scales.  Time  was 
240  minutes. 

Entry  Interview 

This  was  a  background  interview  conducted  on  the  morning  of  the 
assessee's  first  full  day  at  the  assessment  center.  This  exercise 
elicited  information  related  to  the  assessee’s  motivation,  experience,  and 
self-knowledge  of  his  strengths  and  weaknesses.  The  assessee's  composure 
and  style  in  handling  a  communication  situation  also  were  evaluated.  One 
rater  and  fourteen  rating  scales  were  used.  Time  was  90  minutes. 

Appraisal  Interview 

This  was  an  applied  exercise  in  which  the  assessee  was  required  to 
plan  and  conduct  two  interviews  from  which  one  interviewee  would  be 
selected  for  a  position  within  the  Battalion.  The  persons  interviewed 
were  also  assessees.  The  assessee's  written  plan  and  selection  decision 
were  graded  along  with  the  video  tape  of  his  behavior.  This  interview 
exercise  was  designed  to  elicit  behaviors  related  to  communication  skills, 
social  interaction  and  organization  of  thought.  There  were  two  raters  and 
eight  rating  scales.  Time  was  100  minutes. 


In-Basket 


There  were  three  versions  of  the  In-basket.  IOAC  assessees  were 
placed  in  the  role  of  a  new  Battalion  Commander;  I0BC/BI0CC  assessees  were 

placed  in  the  role  of  a  new  Company  Commander  and  ANCOES  assessees  were 

placed  in  the  role  of  a  new  First  Sergeant.  A  full  in-basket  containing 

many  items  typical  of  the  appropriate  position  (letters  to  be  written, 

meetings  to  be  planned,  delegation  of  actions,  etc.)  were  presented  to  the 
assessee  who  had  three  hours  to  address  the  total  number  of  items  in  the 
in-basket.  After  the  assessees'  written  work  was  thoroughly  reviewed,  the 
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assessee  was  interviewed  by  the  assessor  on  his  reasons  and  motives  for 
actions  taken.  This  exercise  was  designed  to  elicit  behaviors  relating  to 
problem  solving,  decision  making,  work  organization  and  leadership.  There 
was  one  rater  who  made  ratings  on  15  rating  scales.  Time  was  180  minutes. 

Writing  Exercise 

This  was  an  exercise  designed  to  measure  accuracy  of  information 
provided,  completeness  of  the  information,  spelling  and  grammar.  The  IOAC 
assessees  responded  to  a  Staff  Action  paper;  the  I0BC/BI0CC  assessees 
responded  to  an  officer's  statement  on  a  discharge  action,  and  the  ANCOES 
assessees  responded  to  a  noncommissioned  officer's  statement  on  discharge 
action.  One  rater  used  four  rating  scales  (five  for  10AC).  Time  was  60 
minutes . 

Leadership  in  a  Simulated  Emergency  (Radio  Simulate) 

This  exercise  required  each  assessee  to  lead  a  group  of  assessees  in 
a  simulated  organization  under  stressful  conditions.  Combat  conditions 
were  simulated  for  the  IOAC  and  ANCOES  assessees  who  had  considerable  Army 
experience,  while  a  civilian  emergency  was  simulated  for  the  IOBC  and 
BIOCC  assessees  who  did  not.  IOAC  assessees  were  placed  in  the  role  of 
Company  Commander;  ANCOES  assessees  in  the  role  of  acting  platoon  leader; 
IOBC  and  BIOCC  assessees,  in  the  role  of  platoon  leader.  Assessees 
received  instructions  from  and  reported  to  one  assessor  who  role-played  as 
a  superior.  Assessees  gave  orders  to  and  received  information  from 
another  assessor  who  role-played  the  assessee' s  subordinates.  This 
exercise  was  designed  to  elicit  organizational  and  leadership  behaviors. 
Two  raters  each  used  eleven  rating  scales.  Time  was  300  minutes. 

PSYCHOMETRIC  TESTS  AND  SELF-DESCRIPTION  INSTRUMENTS 

A  survey  of  tests  in  general  use  revealed  many  possibilities  for 
adoption  into  the  assessment  program.  The  primary  criterion  for  selecting 
specific  tests  was  relevance  of  the  variables  to  be  tested  to  the 
following  dimensions  of  leadership:  administrative  skills,  communication 
skills,  supervisory  skills,  forcefulness,  adaptability,  decision  making, 
and  mental  ability.  The  secondary  criteria  used  in  selecting  tests  were: 
non-offensive  test  items,  suitability  in  content  and  format  for  use  with 
mature  adults,  adequacy  of  normative  data  and  theoretical  discussions, 
recency  of  publication  or  revision  and  efficiency  in  test  administration. 
The  tests  are  listed  and  briefly  described  below.  Additional  information 
on  most  of  these  tests  is  •’vailable  in  the  Mental  Measurement 
Yearbook  (Buros,  1972). 


Henmon-Nelson  Test  of  Mental  Ability 

This  test  was  designed  to  measure  those  aspects  of  mental  ability 
which  are  important  for  success  in  academic  work  and  in  similar  endeavors 
outside  the  classroom.  It  contains  100  items  arranged  in  order  of 
increasing  difficulty.  Item  difficulties  have  been  designed  so  that  the 
test  is  suitable  for  use  with  students  from  the  freshman  year  of  college 
through  the  first  year  of  graduate  school.  Quantitative  and  verbal  scores 
are  obtained  as  well  as  a  total  score. 

Nelson-Penny  Reading  Test 

This  test  assesses  reading  ability  in  terms  of  vocabulary  and 
comprehension.  A  measure  of  reading  rate  is  also  included.  One  hundred 
items  measure  vocabulary  and  36  items  measure  reading  comprehension  and 
reading  rate.  Four  scores  are  obtained:  1)  Vocabulary  score  (V);  2) 
Comprehension  score  (c);  3)  Total  score  (2C  +  IV  =  total  score);  and,  the 
reading  rate  score. 

Chapin  Social  Insight  Test 

This  test  was  designed  to  assess  perceptiveness  and  accuracy  in  appraising 
others  and  forecasting  what  they  will  say  and  do.  Twenty-five  situations 
(items),  drawn  from  case  histories,  literary  descriptions  and  published 
analyses  of  discussions  as  well  as  from  earlier  scales  for  social 
attitudes  and  social  adjustment  were  assembled  into  the  test.  Four 
options  were  written  for  each  situation,  only  one  being  defined  as 
correct.  These  twenty-five  items  have  been  shown  to  discriminate  between 
people  divided  into  high  and  low  on  social  participation  (which  in  turn  is 
correlated  with  social  insight) .  The  five  items  with  the  strongest 
differentiations  are  assigned  a  weight  of  +3  for  correct  responses,  the 
six  items  next  in  differentiative  power  are  given  weights  of  +2,  and  the 
remaining  14  items  are  given  weights  of  +1.  For  the  25  items,  the 
possible  range  of  scores  is  from  0  to  41 • 

Watson-Glaser  Critical  Thinking  Appraisal 

This  test  consists  of  a  series  of  test  exercises  which  require  the 
application  cf  some  of  the  important  abilities  involved  in  critical 
thinking.  The  exercises  include  problems,  statements,  arguments  and 
interpretations  of  data  similar  to  those  which  a  citizen  in  a  democracy 
might  encounter  in  his  daily  life  as  he  works,  reads  newspaper  or  magazine 
articles,  hears  speeches,  participates  in  discussions  on  various  issues, 
etc.  A  high  test  score  indicates  high  mental  ability  and  gives  an 
estimate  of  potential  success  in  certain  types  of  occupations  in  which 
critical  thinking  (careful,  analytical  reasoning)  is  shown  to  play  an 
important  role. 
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Edwards  Personal  Preference  Schedule 


This  self-description  instrument  was  designed  primarily  for  research 
and  counseling  purposes,  to  provide  quick  and  convenient  measures  of  a 
number  of  relatively  independent  normal  personality  variables..  The 
statements  in  the  instrument  and  the  15  variables  that  these  statements 
purport  to  measure  have  their  origin  in  a  list  of  manifest  needs  presented 
by  H.  A.  Murray  and  others. 

Leadership  Opinion  Questionnaire 

This  self-description  instrument  provides  measures  of  two  important 
dimensions  of  supervisory  leadership  -  Consideration  (C)  and  Structure 
(S) .  Originally  identified  in  the  Ohio  State  University  leadership 
studies,  these  two  broad  patterns  have  been  shown  to  be  meaningful  in  a 
wide  variety  of  supervisory-subordinate  situations.  The  two  scores 
provided  by  this  questionnaire  are  defined  as  follows: 

Consideration  (C) .  Reflects  the  extent  to  which  an  individual 
is  likely  to  have  job  relationships  with  his  subordinates 
characterized  by  mutual  trust,  respect  for  their  ideas,  consideration 
of  their  feelings,  and  a  certain  warmth  between  himself  and  them.  A 
high  score  is  indicative  of  a  climate  of  good  rapport  and  two-way 
communication.  A  low  score  indicates  the  individual  is  likely  to  be 
more  impersonal  in  his  relations  with  group  members. 

Structure  (S) .  Reflects  the  extent  to  which  an  individual  is  likely 
to  define  and  structure  his  own  role  and  those  of  his  subordinates 
toward  goal  attainment.  A  high  score  on  this  dimension  characterizes 
individuals  who  play  a  very  active  role  in  directing  group  activities 
through  planning,  communicating  information,  scheduling,  criticizing, 
trying  out  new  ideas,  and  so  forth.  A  low  score  characterizes 
individuals  who  are  likely  to  be  relatively  inactive  in  giving 
direction  in  these  ways. 

Leadership  Q-Sort  Test 

This  self-description  instrument  is  concerned  with  assessing  an 
individual's  values  with  respect  to  the  leadership  role.  The  60 
items  which  are  contained  in  the  test  have  all  been  identified  by 
well -qualified  leaders  as  being  important  to  the  leadership 
function.  The  total  score  provides  an  overall  estimate  of  the 
assessee's  leadership  values  in  comparison  to  the  test  norm  group. 

Scores  that  are  above  60  on  the  profile  chart  are  presumed  to 
indicate  excessively  high  ratings  for  such  items. 
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Person  Description  Blank 


This  was  a  self-description  instrument  in  which  fifty  pairs  of 
adjectives  were  presented  to  each  assessee  (e.g.,  CAPABLE 
1 :2:3:4:5:6:7  INCAPABLE)  with  instructions  for  the  assessee  to  rate 
himself  by  circling  the  number  that  best  describes  his  position 
between  these  polar  adjectives.  The  adjectives  are  presented  in 
Appendix  A.  Three  forms  were  used:  rate  YOURSELF,  rate  the  AVERAGE 
(CPT,  LT,  etc.),  rate  the  IDEAL  (CPT,  LT,  etc.).  Only  the  YOURSELF 
form  was  used  for  analysis. 

Gordon  Work  Environment  Preference  Schedule 


High  scores  on  this  self-description  instrument  typify 
individuals  who  accept  authority,  who  prefer  to  have  specific  rules 
and  guidelines  to  follow,  who  prefer  impersonalized  work 
relationships,  and  who  seek  the  security  of  organizational  and 
in-group  identification.  Low  scores  are  made  by  individuals  who  do 
not  so  characterize  themselves. 
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CONDUCT  OF  THE  ASSESSMENT  CENTER 


Assessment  activities  occupied  three-and-one-half  days  of  the 
assessee's  time.  Days  typically  began  at  0700  with  activities 
continuing  to  2100.  This  allowed  collection  of  a  great  deal  of 
information  in  the  short  time  available,  enhanced  the  "total 
immersion"  experience,  and  reduced  the  effects  of  outside  influences 
on  assessment  center  performance.  Paper  and  pencil  tests,  simulated 
leadership  tasks  and  interviews  were  approximately  equally 
distributed  over  the  three-and-one-half-day  period. 

A  typical  schedule  for  one  man  in  IOAC  class  (2-74)  will  serve 
to  convey  the  flavor  of  the  "total  immersion"  assessment  schedule: 

DAY  1  1530-1600  Welcome  and  Orientation 

1605-1630  In- processing 
1635-1700  Psychometric  Tests  I 
1705-1730  Entry  Questionnaire 
1730-1825  Evening  Meal 

1825-1925  Writing  Exercise  (staff  action  paper) 
1930-2055  Appraisal  Interview  (as  interviewer) 

DAY  2  * **0700-0825  Entry  Interview 

0830-1130  In-Ba3ket  Exercise 
1130-1200  Lunch 
**1200-1555  War  Game  I 

1600-1700  Psychometric  Test  II 
1 800-1 900  Evening  Meal 
1900-2100  Conglomerate  Exercise 

DAY  3  0700-0955  Psychometric  Test  III 

1000-1130  In-Basket  Interview 
1130-1200  Lunch 

1200-1325  Simulate  Preparation 
**1330-1625  War  Game  II 

1630-173 0  Psychometric  Test  IV 
1800-1900  Evening  Meal 

1900-1 920  Appraisal  Interview  (as  candidate) 
1925-2015  Army  War  College  Leadership  Questionnaire 

DAY  4  0700-0750  Appraisal  Interview  (as  candidate) 

0800-0900  Psychometric  Test  V 
0905-1130  Leaderless  Group  Discussion 
1130-1200  Lunch 
1200-1700  Simulate 
1705-1735  Exit  Questionnaire 

*  For  BIOCC,  a  Physical  Training  Test  was  given  at  0530. 

**  For  IOBC,  BIOCC  and  ANCOES,  the  Assigned  Leader  Group  Exercise  replaced 
WAR  GAME  I  and  II. 
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The  staff  was  fully  occupied  both  during  and  between  assessment  periods. 
During  an  assessment  period,  the  assessors  expended  over  413  man  hours  in 
actually  conducting  assessment  exercises  and  preparing  reports.  Between 
assessment  periods,  the  assessors  prepared  data  for  reduction  and 
analysis,  and  prepared  for  the  counseling  sessions  when  the  ass.essees 
returned  for  feedback  counseling  from  one  to  three  weeks  following  their 
assessment.  During  this  three-hour  counseling  period  the  assessee's 
leadership  strengths  and  weaknesses,  as  identified  in  the  assessment 
center,  were  communicated  and  activities  were  suggested  which  would  lead 
to  correction  of  deficiencies. 


METHOD 


ASSESSEES 

Assessees  were  408  junior  officers,  NCOs  and  BIOCC  candidates  who 
were  scheduled  for  training  at  USAIS.  Table  1  presents  the  numbers  and 
characteristics  of  the  four  major  groups  of  assessees  including  numbers 
with  criterion  data.  These  students  were  randomly  selected  from  the  total 
group  of  students  entering  their  class.  They  received  orders  to  report  to 
Fort  Benning  one  week  earlier  than  their  classmates  to  participate  in  the 
assessment  center.  For  purposes  of  determining  leadership  development  (if 
any)  that  assessment  and  counseling  produced  in  assessees,  IOAC  and  ANCOES 
assessees  were  matched  with  non-assessed  classmates  to  provide  a  control 
group.  Rank/grade,  combat  experience,  civilian  education  level,  source  of 
commission,  command  experience,  and  MOS  were  the  variables  used  for  this 
matching. 

In  addition  to  these  408  assessees,  assessments  were  made  on  41  ROTC 
students  from  nearby  universities  and  on  33  captains  from  the  197th 
Infantry  Brigade  at  Fort  Benning.  These  were  conducted  to  determine  the 
feasibility  of  using  the  assessment  center  for  these  populations  and  to 
provide  feedback  to  the  197th  captains  on  their  strengths  and  weaknesses. 
Assessment  and  feedback  were  well  received  by  both  groups.  No  follow-up 
evaluation  of  these  personnel  has  been  conducted  and  they  receive  no 
further  discussion  in  this  report. 

DESIGN  OF  THE  VALIDATION  OF  THE  USAIS  ASSESSMENT  CENTER 

LEADERSHIP  PERFORMANCE  RATINGS.  The  originally  planned  method  of 
evaluation  of  the  assessment  center  was  to  determine  whether  the  data 
would  predict  field  leadership  ratings  obtained  six  months  and  18  months 
following  assignment  of  the  assessees  to  their  post-leadership- training 
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TABLE  1 


ASSESSEE  GROUP  CHARACTERISTICS  AND  SIZES 


Descriptor 

IOBC 

ASSESSMENT  GROUP 

IOAC  BIOCC(OCS) 

ANCOES 

Number  Assessed 

90 

88 

143 

87 

Pay  Grade 

0-1 

0-3 

E  3-6 

E  6-7 

Average  Age 

22.6 

28.8 

25.3 

33.3 

Average  Years  of 

Active  Duty 

0.3 

5.7 

3.3 

12.9 

Number  With  Complete 

Field  Leadership 

Ratings 

45 

36 

40 

38 

Number  Completing 

Leadership  Courses 

87 

84 

105 

79 

Number  With 

OER  Ratings 

69 

67 

84 

— 
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assignments.  A  special  Leadership  Performance  Rating  Form  (LPRF)  was 
developed  for  this  purpose  (Salter  and  Olmstead,  1974)  and  is  included  in 
Appendix  B.  The  50  questions  on  this  form  were  designed  to  provide  data 
on  10  leadership  dimensions.  These  dimensions  were  Decision  Making, 
Administrative  Skills,  Interpersonal  Competence  (Social  Skills), 
Communication  Skills,  Supervisory  Skills,  Organizational  Role  Skills, 
Technical/Tactical  Competence,  Leader  Motivation,  Leader  Adaptability,  and 
Leader  Forcefulness.  Five  questions  were  included  for  each  dimension. 

The  current  unit  assignment  for  each  assessee  and  match  were  obtained  from 
MILPERCEN  F0RSC0M.  The  LPRF's  were  sent  to  the  Commanding  Officer  of  each 
appropriate  unit  to  be  distributed  to  two  superiors,  two  peers  and  two 
subordinates  of  the  assessee  (or  match).  When  a  LPRF  was  completed,  the 
rater  used  an  attached  pre-labeled  return  envelope  to  insure 
confidentiality  of  his  ratings. 

Approximately  one-half  of  the  questionnaires  were  returned.  Rating 
data  from  at  least  one  superior,  peer  and  subordinate  were  obtained  on  159 
of  the  original  408  assessees  at  six  months,  and  similar  "complete  data" 
were  obtained  on  108  assessees  at  both  six  and  18  months. 

The  average  of  all  300  ratings  (50  items  for  each  of  six 
questionnaires)  was  calculated  for  the  six-month  period  and  for  the  18 
month  period.  The  correlations  between  these  two  averages  ranged  from  .54 
for  the  IOBC  assessees,  through  .68  for  the  IOAC  assessees,  to  .75  for  the 
ANCOES  assessees.  Only  15  BI0CC  assessees  had  complete  rating  data  for  6 
and  18  months  and  the  negative  correlation  between  six-  and  18-month 
averages  for  this  group  (  -.35)  may  have  been  a  spurious  result.  The 
six-month/18-month  correlation  may  be  thought  of  as  a  test/retest 
reliability.  These  correlations  are  surprisingly  high  since  many  factors 
could  operate  to  change  leadership  over  the  12-month  period  between 
ratings  and  because  of  the  relatively  short  time  for  observation  of 
leadership  prior  to  the  first  ratings  (six  months).  Correlations  between 
average  ratings  for  different  rater  types  (superior,  peer,  subordinate) 
were  also  generally  positive  and  significant  for  each  rating  period. 

Table  2  presents  these  correlations  for  the  six-month  average  ratings. 

Although  the  correlations  between  six-  and  18-month  averages  indi¬ 
cate  the  overall  average  rating  at  a  rating  period  was  highly  reliable, 
the  questionnaire  failed  to  discriminate  among  the  ten  dimensions  that 
presumably  were  represented  in  the  fifty  items.  This  was  shown  by 
separate  principal  components  factor  analyses  for  each  assessment  group 
of  the  50-item  intercorrelation  matrix  derived  from  average  ratings  by 
the  six  raters  for  each  item.  These  factor  analyses  indicated  only 
one  significant  factor  which  accounted  for  79%  to  81%  of  the  common 


13 


TABLE  2 


CORRELATIONS  BETWEEN  DIFFERENT  RATER  GROUPS  FOR 
AVERAGE  FIELD  LEADERSHIP  RATINGS  AT  SIX  MONTHS 


Assessment 

Group 

Superior  with 
Subordinate 

Superior  with 
Peer 

Subordinate 
with  Pter 

IOAC 

.29 

.37 

.44 

IOBC 

.39 

.29 

.04 

BIOCC 

.34 

.44 

.25 

ANCOES 

.42 

.53 

.32 

14 


i 


variance  for  the  four  asaessee  groups.  It  is  not  clear  whether  the 
failure  to  discriminate  among  leadership  dimensions  reflected  on  the 
ratees'  ability  to  discriminate  dimensions,  or  whether  the  different 
leadership  dimensions  are  as  interdependent  as  these  high  correlations 
indicate . 

Since  much  more  data  were  available  for  the  six-month  rating  period 
(with  almost  no  18-month  data  from  the  BIOCC  assessees)  and  since  a  high 
correlation  existed  where  such  data  were  available,  the  average  rating  for 
all  300  questions  (six  raters  x  50  questions)  at  the  six-month  rating 
period  was  used  as  the  field  leadership  criterion  to  validate  the 
assessment  center  measures.  When  a  questionnaire  from  only  one  superior, 
peer  or  subordinate  was  available  the  items  were  given  double  weight. 

OFFICER  EVALUATION  REPORT.  Other  measures  of  leadership  success,  however, 
are  available  and  may  be  even  more  appropriate  criteria  for  validating  the 
assessment  center.  In  particular,  Officer  Evaluation  Report  (OER)  ratings 
are  critical  for  career  progression.  The  OER  form  is  included  in  Appendix 
C.  An  officer  who  is  "effective"  and  who  "should  be  promoted  with  his 
contemporaries"  could  theoretically  receive  an  OER  rating  as  low  as  46. 
However  almost  all  officers  are  rated  within  a  few  points  of  the  200 
maximum  and  higher  grades  of  officers  tend  to  have  higher  average  ratings. 
Despite  the  partial  "ceiling"  effect,  sufficient  variance  existed  in  the 
OERs  for  the  assessees  to  have  correlations  between  last  OER  and  four 
previous  OERs  which  averaged  .50  for  IOBC  assessees,  .47  for  IOAC 
assessees  and  .62  for  BIOCC  assessees.  These  intercorrelations  indicate 
substantial  reliability  of  these  measures. 

LEADERSHIP  COURSE  GRADES.  Although  the  four  USAIS  courses  attended  by  the 
four  groups  of  assessees  following  assessment  are  all  referred  to  as 
leadership  courses,  many  other  factors  than  leadership  are  covered  in 
their  curricula.  For  this  reason  and  for  the  fact  that  they  constitute 
"academic"  performance,  the  end-of-course  grades  may  not  be  an  ideal 
leadership  criterion  with  which  to  validate  the  assessment  center.  Their 
inclusion  in  this  report  reflects  as  much  on  their  availability  as  it  does 
on  their  suitability. 

The  "Leadership"  courses  ranged  in  length  from  12  weeks  for  the 
Infantry  Officer  Basic  Course  (lOBC)  and  the  Advanced  NCO  Educational 
System  (ANCOES)  through  14  weeks  for  the  Branch  Immaterial  Officer 
Candidate  Course  (BIOCC)  to  36  weeks  for  the  Infantry  Officer  Advanced 
Course  (IOAC).  Table  3  lists  the  number  of  hours  which  were  devoted  to 
different  subjects  in  each  of  these  courses. 

Tables  4  and  5  illustrate  the  number  of  examination  points  associated 
with  different  activities.  The  total  possible  score  was  1000  for  each  of 
the  courses.  Actual  means  and  standard  deviations  for  the  total  scores 
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TABLE  3 


ACADEMIC 

HOURS  FOR 

FOUR  ACTR 

GROUPS 

Title 

IOBC 

IOAC 

BIOCC 

ANCOES 

Combined  arms  subjects 

282.5 

510.0 

100.0 

102.0 

Staff  subjects 

27.0 

193.0 

44.0 

119.0 

General  subjects 

83.5 

117.5 

188.0 

106.5 

Communications /Electronics 

10.0 

23.0 

11.0 

15.0 

Unit /Materiel  readiness 

42.5 

44.0 

23.0 

16.0 

Weapons 

73.0 

44.0 

50.0 

18.0 

Student  Evaluation 
&  Counselling 

36.0 

100.0 

105.0 

20.0 

Electives 

- 

45.0 

- 

42.0 

Guest  Speaker  program 

- 

18.0 

- 

- 

554.5 

1094.5 

521.0 

438.5 
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TABLE  4 


COMPOSITION  OF  TOTAL  SCORE  FOR  IOBC  AND  IOAC  GROUPS 


IOBC  IOAC 


Subject 

Points 

Subject 

Points 

Map  reading 

10 

Medical  services  support  quiz 

10 

Pro  facts 

50 

Indoor  land  navigation 

25 

Land  navigation  (field) 

120 

Leadership  management 

45  • 

Leadership 

100 

Staff  functions 

125 

Mil  stakes  Part  I* 

140 

Nuclear,  Chemical,  Biological 

Mil  stakes  Part  II* 

170 

operations  (NCB) 

35 

Patrolling 

10 

Maintenance  management 

55 

Patrolling  evaluation 

100 

Engineer 

10 

Army  Physical  Fitness  Test 

(APFT)  100 

Communications 

25 

Communicat ion/maintenance 

100 

Fact  sheet 

10 

Written  Performance 

100 

Disposition  Form 

10 

Cmt  2  to  Disposition  Form 

10 

1000 

Artillery 

25 

Graphics  quiz 

10 

Operations 

30 

Company  tactical  oper,  field 

80 

Company  tactical  oper,  field 

75 

Company  tactics 

25 

Bn  defense 

50 

Bn  offense 

50 

Internal  defense  dev 

30 

Aerial  employment 

35 

Memorandum 

10 

Staff  study 

40 

Response  to  nonconcurrence 

10 

Indorsement  military  ltr 

10 

Final  Comp  Part  I 

50 

Bde  defense 

30 

Bde  offense 

30 

Final  Comp  Part  II 

50 

1000 


*"Hands-on" 


performance 


test  of  various  equipment. 
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TABLE  5 


COMPOSITION  OF  TOTAL  SCORE 


BIOCC 

Subject  Points 

Squad  drill  performance  60 

Platoon  drill  60 

Oral  presentation  50 

Land  navigation  field  exam  15 

Phase  I  Comp  120 

Land  navigation  field  120 

Maintenance  management  100 

Phase  II  Comp  175 

Army  Physical  Fitness  Test  (APFT)  100 
Phase  III  Comp  200 

1000 


FOR  BIOCC  AND  ANCOES  GROUPS 

ANCOES 


Subject 

Points 

Land  navigation  outdoor 

40 

Land  navigation  indoor 

40 

Communications 

40 

Graphics 

10 

Leadership  Group,  Medical 

55 

Weapons 

95 

Maintenance 

70 

Combat  Support 

85 

Mechanized  Training 

70 

Forward  observer 

80 

Fire  direction  control  (FDC)  I 

90 

Writing  Req  Mil  ltr 

15 

FDC  II 

80 

FDC  III 

85 

Spot  Quiz 

10 

Fundamentals  of  Tactics 

35 

Cmt  2  to  Disposition  Form 

15 

Staff 

85 

1000 


obtained  by  the  assessees  are  given  in  Table  6.  No  data  were  available  on 
the  variances  of  subtests  of  the  total  score  and  it  is  thus  impossible  to 
accurately  estimate  how  much  each  subtopic  added  to  the  total  score. 
However,  the  points  of  the  subtest  probably  reflect  to  some  measure  its 
contribution.  Subtest  scores  were  not  available  for  separate  correlations 
with  the  assessment  center  measures. 

For  the  most  part  in  these  courses,  the  instruction  was  conducted  by 
the  lecture  method  and  testing  was  traditional  paper-and-pencil  multiple 
choice.  The  exceptions  are  the  military  stakes  and  PT  testing  of  the  IOBC 
curriculum. 

OTHER  EVALUATION  QUESTIONS.  Questions  of  the  possible  leader  development 
provided  to  assessees  by  assessment  and  feedback  of  assessment  results 
were  planned  originally  to  be  answered  by  comparing  LPRF  data  for 
assessees  with  data  from  the  matched  controls  who  did  not  attend  the 
assessment  center.  Finally,  attrition  in  BIOCC  was  to  be  related  to 
assessment  center  data  to  evaluate  its  potential  for  selecting  BIOCC 
trainees . 

RESULTS 

LPRF  RATINGS,  OER  RATINGS  AND  COURSE  GRADES 


Before  discussion  of  the  correlations  of  assessment  center  measures 
with  the  three  criteria,  it  is  important  to  establish  the  nature  and 
magnitude  of  the  relationships  among  the  different  criterion  measures. 

The  three  correlations  for  each  (officer)  assessee  group  are  shown  in 
Table  7.  There  were  significant  positive  correlations  between  the  LPRF 
measure  and  the  OER  for  each  assessee  group.  This  suggests  that  these  two 
types  of  leadership  rating  have  much  in  common  despite  a  three  year 
difference  between  rating  periods.  Somewhat  smaller  correlations  exist 
between  the  LPRF  measure  and  the  end-of-course  grade.  End-of-course 
grades  show  a  single  significant  correlation  with  the  OER  for  the  BIOCC 
group  but  insignificant  correlations  for  the  other  two  groups. 

Only  the  LPRF  and  end-of-course  grade  existed  for  the  ANCOES  group. 
The  -.43  correlation  between  these  measures  indicates  that  those  NCOs  who 
did  well  in  ANCOES  were  apt  to  be  rated  low  on  the  LPRF.  This  unexpected 
negative  correlation  casts  doubt  on  the  suitability  of  one  or  the  other 
(perhaps  both)  of  these  criteria  of  NCO  leadership. 

ASSESSMENT  CENTER  -  LEADERSHIP  CRITERIA  RELATIONSHIPS 

The  scores  obtained  from  the  USAIS  Assessment  Center  fall  into  the 
following  six  classes: 


TABLE  6 

MEANS  AND  STANDARD  DEVIATIONS  FOR  TOTAL  SCORES 


Group 

N 

Mean 

Standard  1 

IOBC 

87 

857.84 

41.56 

10  AC 

84 

839.74 

47.10 

BIOCC 

105 

876.53 

46.52 

ANCOES 

79 

810.38 

54.41 
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TABLE  7 


INTERCORRELATIONS  BETWEEN  THE 
THREE  LEADERSHIP  CRITERIA 


Assessment 

Group 

Last  OCR 
with  Average 
LPRF 

Last  OER  with 
End-of-Course 
Grade 

Average  LPRF 
with  End-of- 
Course  Grade 

IOAC 

.39 

.13 

.30 

IOBC 

.33 

.04 

.15 

BIOCC 

.45 

.43 

.25 

ANCOES 

N/A 

N/A 

-.43 

1 
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1.  Assessor  ratings  of  assessee  performance  during  individual  and 
group  formal  exercises  such  as  the  In-Basket  and  Leader] ess  Group 
Discussion , 


2.  Peer  rankings  of  assessees  in  those  formal  exercises  'where  a 
group  of  assessees  participated  together  such  as  the  Assigned  Leader  Group 
Exercise , 


3.  Self  rankings  by  the  assessee  of  his  performance  relative  to 
other  group  members  in  these  group  exercises, 

4.  Leadership  dimension  ratings  made  by  an  assessor  during  the 
Entry  Interview  with  the  assessee, 

5*  Assessee  performance  on  paper  and  pencil  performance  tests,  and 

6.  Assessee  self  descriptions  on  questionnaires  and  other 
instruments  such  as  the  Edwards  Personal  Preference  Schedule. 

The  results  will  be  discussed  for  each  of  the  above  classes  of  score. 
Following  this,  these  classes  of  assessment  center  scores  will  be 
discussed  and  compared  on  their  effectiveness  for  prediction  of  the  three 
leadership  criteria. 

1.  ASSESSOR  RATINGS  OF  ASSESSEE  PERFORMANCE  DURING  FORMAL  EXERCISES 
Leaderless  Group  Discussion 

Correlations  with  the  three  leadership  criteria  of  the  assessor 
ratings  in  the  Leaderless  Group  Discussion  are  presented  in  Table  8.  The 
major  pattern  in  these  correlations  was  the  large  number  of  significant 
correlations  that  existed  for  the  end-of-course  grade.  For  the  other 
leadership  criteria  (LPRF  and  OER)  only  a  very  few  correlations  were 
significant.  Two  of  these  for  the  IOBC  assessment  group,  however,  were 
substantial.  One  was  the  -.56  correlation  between  LPRF  and  "negative 
impression"  which  indicated  that  IOBC  assessees  who  showed  more  negative 
social  behavior  were  more  likely  to  be  rated  high  on  field  leadership. 

The  other  was  "social  concern"  which  was  correlated  -.37  with  the  LPRF. 
Those  IOBC  assessees  who  demonstrated  less  social  concern  were  more  apt  to 
be  rated  high  on  the  LPRF  six  months  after  assignment  to  TOdE  units. 

For  BIOCC  assessees,  "social  concern"  was  significantly  related  to 
the  LPRF  criterion  (r*.31»  p<.05)  but,  contrary  to  IOBC,  high  social 
concern  was  related  to  good  ratings  on  the  criterion.  "Amount  of  negative 
social  behavior"  showed  a  similar  reversed  relation  to  this  criterion 
(compared  to  IOBC)  although  the  correlation  was  not  significant  (r=.24, 

p=.06) . 
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CORRELATIONS  WITH  THE  CRITERIA 
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For  ANCOES  assessees,  the  Leaderless  Group  Discussion  produced  a 
3ingle  significant  relation  with  the  LPRF  criterion.  The  dimension 
"conveys  information"  was  correlated  negatively  (r=  -.32,  p<.05), 
indicating  that  persons  rated  lower  on  this  communication  skill  dimension 
were  more  apt  to  be  rated  high  on  the  LPRF  criterion.  As  will  be  shown 
throughout  this  section,  poor  performance  for  NCOs  on  the  Assessment 
Center  exercises  was  frequently  related  to  higher  ratings  on  the  LPRF 
criterion  and  vice  versa.  The  same  dimension  "conveys  information"  was 
positively  correlated  with  ANCOES  course  grade  (r=.31,  p<.Ol). 

Assessor  ratings  on  the  Leaderless  Group  Discussion  failed  to  predict 
any  criterion  other  than  course  grade  for  the  IOAC  assessee  group. 

Conglomerate  Exercise 

Correlations  of  assessor  ratings  with  the  three  criteria  for  this 
exericise  are  presented  in  Table  9*  Assessor  ratings  on  this  exercise 
showed  almost  no  significant  correlations  with  either  the  LPRF  or  OER 
ratings.  Only  "receptivity"  for  the  BIOCC  assessees  showed  a  positive 
relationship  with  the  LPRF  (r=.36,  p<.Ol)  and  "energy  and  vigor"  showed  a 
negative  relationship  for  IOBC  assessees  (r=  -.26,  p<.05).  The  latter 
indicates  that  assessees  who  were  lower  in  energy  and  vigor  were  more  apt 
to  be  rated  high  on  the  LPRF.  Although  most  are  not  significant,  almost 
all  of  the  Conglomerate  Exercise  correlations  with  LPRF  and  OER  ratings 
were  negative  for  IOAC  and  IOBC.  Willingness  to  play  this  Conglomerate 
management  game  at  the  assessment  center  tended  to  be  associated  with  poor 
leadership  ratings  six  months  (LPRF)  and  three  years  (OER)  following 
completion  of  Infantry  Leadership  courses. 

For  IOAC  and  ANCOES  assessees  almost  all  correlations  of  Conglomerate 
exercise  assessor  ratings  with  their  leadership  course  grades  were 
significant  and  positive.  A  similar  trend  existed  for  BIOCC,  with  all 
correlations  with  BIOCC  end-of-course  grade  positive  and  three  of  them 
significant.  For  these  three  assessment  groups,  performance  in  the 
Conglomerate  game  tended  to  go  with  performance  in  leadership  courses. 

Radio  Simulate 

Assessor  ratings  for  this  exercise  fell  into  two  categories.  One  set 
of  assessor  ratings  came  from  an  assessor  who  played  a  role  of  a 
subordinate  of  the  assessee  in  the  exercise.  These  are  designated 
"Platoon  Assessor  Ratings"  and  are  presented  in  Table  10.  The  other  set 
of  ratings  came  from  an  assessor  who  played  a  superior  of  the  assessee  in 
tie  eiercise.  These  correlations  of  these  ratings  with  the  three  criteria 
are  designated  "Battalion  Assessor  Ratings"  and  are  presented  in  Table  11. 
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An  unusual  pattern  of  correlations  exists  in  Tables  10  and  11  for  the 
ANCOES  assessment  group.  Almost  every  assessor  rating  predicted  the 
ANCOES  end-of-course  grade  with  high  ratings  going  with  high  grades. 
However,  correlations  of  Radio  Simulate  assessor  ratings  with  the  LPRF 
ratings  for  ANCOES  assessees  were  generally  negative  indicating  that  good 
performance  on  the  Radio  Simulate  was  related  to  poor  ratings  six  months 
following  assignment  to  TO&E  units.  This  result  is  not  easily  explained, 
but  it  does  at  least  fit  with  the  negative  correlation  described  earlier 
between  ANCOES  end-of-course  grade  and  LPRF  ratings  for  ANCOES  assessees. 

Assessor  ratings  for  the  BIOCC  group  showed  strong  relationships  with 
the  BIOCC  end-of-course  grade  and  fairly  strong  and  positive  relationships 
with  the  OER  ratings.  On  the  other  hand,  no  significant  correlations 
existed  for  this  group  between  assessor  ratings  and  the  LPRF  ratings. 

In-Basket 


Assessor  ratings  in  the  In-Basket  exercise  provided  many  significant 
correlations  with  leadership  criteria  for  the  IOAC  assessment  group  (See 
Table  12).  This  was  particularly  true  for  the  end-of-course  grade  but 
also  for  the  OER  and  LPRF  ratings.  End-of-course  grades  were  predicted 
somewhat  less  well  for  the  ANCOES  assessees  although  all  14  correlations 
were  positive  and  half  of  them  were  significant  at  at  least  the  .05  level. 
On  the  other  hand,  for  the  ANCOES  group  all  14  correlations  with  the  LPRF 
ratings  were  negative  including  two  significant  and  four  nearly 
significant  ones. 

For  the  I0BC  and  BIOCC  groups,  assessor  ratings  on  the  In-Basket 
frequently  correlated  positively  with  end-of-course  grades,  but  the  two 
groups  showed  different  patterns  on  the  LPRF  and  OER  ratings.  IOBC 
assessor  ratings  are  consistently  negatively  correlated  with  both  of  these 
criteria  but  BIOCC  assessor- ratings  correlations  are  consistently 
positive.  This  is  surprising  since  both  groups  were  new  lieutenants  when 
rated  on  the  LPRF  and  had  similar  amounts  of  experience  when  receiving  the 
last  OER  rating. 

Appraisal  Interview 

Assessor  ratings  were  made  on  eight  dimensions  in  the  Appraisal 
Interview.  The  correlation  of  these  with  the  three  leadership  criteria 
for  the  three  assessment  groups  are  presented  in  Table  13.  The  first  four 
dimensions  were  significant  predictors  of  the  end-of-course  grade  for 
three  of  the  four  assessment  groups.  The  only  significant  correlations 
with  either  the  LPRF  or  OER  ratings  were  negative.  This  again  indicated 
the  different  nature  of  the  leadership  criteria. 
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TABLE  13 


** 


Writing  Exercise 


Assessor  ratings  were  made  on  five  dimensions  for  the  IOAC  assessment 
group  and  four  for  the  other  three  groups.  Their  correlations  with 
leadership  criteria  are  presented  in  Table  14*  Best  predictions  for  this 
exercise  occurred  for  the  IOBC  and  BIOCC  groups. 

Assigned  ueader  Group  Exercise 

Correlations  of  assessor  ratings  for  the  Assigned  Leader  Group 
Exercise  with  the  three  leadership  criteria  are  presented  in  Table  15. 

IOAC  assessees  did  not  participate  in  this  exercise.  No  significant 
predictions  of  either  leadership  rating  (OER  or  LPRF)  were  found  for  the 
two  officer  groups  who  did  participate.  The  end-of-course  grade  was 
predicted  by  some  of  these  ratings  for  all  groups.  Ratings  on  "leadership 
emergence"  and  "group  facilitation"  were  positively  correlated  with  the 
LPRF  ratings  for  ANCOES  assessees.  "Flexibility"  was  negatively 
correlated  with  the  LPRF  for  the  same  group. 

Leader  Game 


Only  the  IOAC  assessment  group  participated  in  this  exercise. 

Although  it  was  strongly  related  to  IOAC  end-of-course  grades  (See  Table 
16),  only  the  dimension  of  "flexibility"  correlated  with  LPRF  ratings. 
Assessees  with  high  flexibility  tended  to  have  better  LPRF  ratings.  The 
correlation  of  "participation"  with  end-of-course  grade  was  .47  and  was 
one  of  the  highest  correlations  obtained  in  this  study  for  assessor 
ratings. 

2.  PEER  RANKING  ON  GROUP  EXERCISES 
Leaderless  Group  Discussion 

The  six  members  who  participated  in  this  exercise  ranked  all  six 
members  on  a  number  of  different  dimensions  and  the  correlations  with  the 
three  criteria  of  these  rankings  are  presented  in  Table  17.  These  peer 
rankings  produced  significant  correlations  with  the  end-of-course  grade 
criterion  for  all  assessment  groups.  For  the  BIOCC  assessment  group,  four 
of  the  six  dimensions  were  significantly  related  to  the  OER  rating.  None 
of  the  other  groups  showed  significant  peer-ranking  relationships  with  the 
OER  and  no  groups  showed  any  significant  correlations  with  the  LPRF  rating 
for  any  of  the  six  dimensions. 

Conglomerate  Exercise 

These  peer  ranking  -  leadership  criterion  correlations  are  given  in 
the  top  of  Table  18.  Three  of  five  dimensions  were  significantly  related 
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TABLE  16 


CORRELATIONS  WITH  THE  CRITERIA  OF  LEADER  GAME 
RATINGS  AND  RANKINGS  (IOAC  ONLY) 


Leader  Game 

Measures 

OER 

LPRF 

End-of-Course 

Grade 

Assessor  Ratings 

Organization 

.17 

.15 

Leadership 

.09 

.31** 

Planning 

.14 

.25* 

Flexibility 

.15 

-.36* 

.05 

Supervisory  Skills 

.09 

.13 

.29** 

Participation 

-.15 

-.21 

.47** 

Problem  Comprehension 

.03 

-.13 

.33** 

Leadership  Emergence 

-.08 

-.21 

.39** 

Overall  Effectiveness 

-.06 

-.14 

.36** 

Peer  Rankings 

Problem  Comprehension 

.03 

.02 

.50** 

Leadership 

.16 

.12 

.43** 

Support  of  Leader 

.02 

-.01 

.39** 

General  Esprit 

-.02 

-.11 

.24* 

Overall  Effect 

.05 

.10 

.43** 

Self-Rankings 

Problem  Comprehension 

-.03 

-.03 

.38** 

Leadership 

-.01 

.00 

.35** 

Support  of  Leader 

-.09 

-.13 

.34** 

General  Esprit 

-.09 

-.16 

.19* 

Overall  Effect 

-.06 

-.04 

.34** 

3 


ITH  THE  CRITERIA 


TABLE  18 


to  the  end-of-course  grade  for  the  IOAC,  IOBC  and  ANCOES  groups.  No 
correlations  with  the  LPRF  criterion  were  significant  for  any  assessment 
group.  A  single  correlation  with  the  OER  criterion  was  significant  for 
IOBC  and  for  BIOCC. 

Assigned  Leader  Group  Exercises 

Peer  rankings  on  this  exercise  provided  significant  predictions  of 
the  end-of-course  grade  for  the  IOBC  and  BIOCC  groups  hut  not  the  ANCOES 
group.  These  correlations  are  presented  in  the  top  half  of  Table  19. 
Three  of  four  peer  rankings  for  the  ANCOES  group  predicted  the  LPRF 
rating.  For  the  IOBC  assessment  group  neither  the  LPRF  nor  OER  ratings 
were  predicted  by  peer  rankings  on  this  exercise.  For  BIOCC  assessees 
"social  association”  predicted  the  LPRF  and  "leadership"  predicted  the 
OER. 

Leader  Game 


Peer  rankings  on  this  exercise  (IOAC  only)  produced  highly 
significant  correlations  with  the  end-of-course  grade  criterion  (See  Table 
16).  Yet  not  one  of  these  rankings  predicted  either  the  LPRF  or  the  OER 
ratings.  Assessor  ratings,  and,  as  will  be  seen,  self  rankings  showed 
this  same  pattern  of  high  correlations  with  the  end-of-course  grade  and 
almost  no  correlation  with  the  other  two  leadership  criteria. 

3.  SELF  RANKINGS  ON  THE  GROUP  EXERCISES. 

Leaderless  Group  Discussion 

These  results  are  shown  in  Table  20.  The  self-rankings  provided  four 
(out  of  six)  significant  predictions  of  the  end-of-course  grade  for  the 
IOAC  group.  For  the  other  groups,  little  predictive  validity  was  found 
for  any  criterion. 

Conglomerate  Exercise 

These  results  are  shown  at  the  bottom  of  Table  18.  These 
self- rankings  provided  four  (out  of  five)  significant  predictions  of  the 
end-of-course  grade  for  the  IOAC  group.  Good  predictions  of  the  LPRF 
criterion  occurred  for  the  ANCOES  group.  For  other  groups  little 
predictive  validity  was  found  for  any  criterion. 

Assigned  Leader  Group  Exercise 

These  correlations  are  given  on  the  bottom  half  of  Table  19-  For  the 
ANCOES  group  and  the  LPRF  criterion  the  results  parallel  data  from  the 
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corresponding  peer  rankings  with  good  prediction  of  this  criterion  for 
this  group. 

Leader  Game 

Results  are  given  in  Table  16  at  the  bottom.  Results  are  similar  to 
those  for  peer  ranking  with  good  predictions  of  the  end-of-course  grade 
and  no  significant  correlations  with  the  other  two  criteria. 

4.  ENTRY  INTERVIEW  PERFORMANCE  EVALUATION 

Fourteen  dimensions  were  rated  during  the  Entry  Interview  and  their 
correlations  with  the  criteria  are  presented  in  Table  21 .  LPRF  ratings 
were  predicted  by  six  dimensions  of  the  BIOCC  assessment  group. 
"Enthusiasm"  was  a  dimension  that  predicted  the  LPRF  for  the  ANCOES  group. 
In  general,  best  predictions  occurred  for  the  end-of-course  grade  as  was 
the  case  for  nearly  all  assessment  center  data. 

5.  PENCIL  AND  PAPER  PERFORMANCE  TESTS 

These  were  the  best  predictors  of  the  end-of-course  grades  and,  in 
fact,  provide  some  of  the  highest  correlations  obtained  between  the 
assessment  center  data  and  all  three  criteria.  Only  for  the  BIOCC 
assessment  group  were  there  any  positive  correlations  between  these 
performance  tests  and  the  other  criteria.  Specifically,  only  the 
correlation  of  the  Henraon-Nelson  quantitative  and  Nelson-Denny 
comprehensive  scores  of  the  BIOCC  assessees  with  the  OER  criterion  were 
positive  and  significant. 

Many  significant  negative  correlations  were  found  for  the  IOBC  group 
between  these  performance  scores  and  the  OER.  Large  negative  correlations 
also  were  found  for  the  ANCOES  group  between  these  performance  scores  and 
the  LPRF  ratings.  These  data  are  presented  in  Table  22  and  nowhere  was 
the  difference  between  leadership  criteria  more  dramatically  illustrated. 
To  some  extent,  these  scores  on  the  performance  tests  may  be  considered 
"IQ"  scores.  High  IQ  while  an  asset  for  achieving  good  leadership  course 
performance,  apparently  was  a  liability  for  leadership  ratings.  Why  this 
was  true  for  IOBC  and  not  BIOCC  assessees  (for  the  OER  criterion)  is  not 
easy  to  explain  since  both  groups  were  new  lieutenants. 


6.  SELF-DESCRIPTION  INSTRUMENTS 
Edwards  Personal  Preference  Schedule 


Those  EPPS  variables  which  showed  one  or  more  significant 
correlations  with  the  criteria  are  presented  in  Table  23« 
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TABLE  22 


CORRELATIONS  WITH  THE  CRITERIA  OF 


Work  Environment  Preference  Schedule 


High  scores  on  this  measure  "typify  individuals  who  accept  authority, 
who  prefer  to  have  specific  rules  and  guidelines  to  follow,  who  prefer 
impersonal i zed  work  relationships,  and  who  seek  the  security  of 
organizational  and  in-group  identification."  Three  of  the  assessee  groups 
showed  significant  correlations  on  this  measure  with  the  criterion  of 
end-of-course  grades.  For  the  IOAC,  BIOCC  and  ANCOES  assessee  groups 
inverse  relationships  were  found  with  this  criterion  (r=  -.28;  -.29,  p< 
.01;  r=  -.24,  p<  .05,  respectively).  These  inverse  relationships  indicate 
that  those  assessees  readily  accepting  authority  tended  to  receive  low 
end-of-course  grades.  This  test  score  did  not  correlate  significantly 
with  the  end-of-course-grade  criterion  for  the  IOBC  assessee  group. 

Only  one  of  the  assessee  groups  showed  a  significant  correlation  of 
their  scores  on  this  measure  with  the  LPRF  field  leadership  ratings.  IOAC 
assessees  who  were  higher  on  the  Work  Environment  Preference  Schedule  were 
more  likely  to  receive  high  criterion  ratings  ( r=  .32,  p<.05).  The  IOBC, 
BIOCC  and  ANCOES  groups  did  not  have  significant  correlations  between  the 
LPRF  criterion  and  this  measure. 

The  Work  Environment  Preference  Schedule  measure  did  not  correlate 
significantly  with  the  OER  rating  for  any  of  the  assessment  groups. 

Leader  Opinion  Questionnaire 

The  Leader  Opinion  Questionnaire  provides  two  scores:  Consideration 
and  Structure.  BIOCC  assessees  scoring  high  on  Consideration  on  the  LOQ 
were  more  apt  to  receive  a  high  end-of-course  grade  (r=.24,  p<.0l). 
"Structure",  on  the  other  hand,  was  inversely  correlated  with  the 
criterion  for  the  BIOCC  assessees  (r=  -.34,  p<.0l).  These  scores  were  not 
significantly  related  to  course  grades  for  the  other  assessee  groups. 

ANCOES  assessees  scoring  high  on  "Consideration"  were  more  apt  to  be 
rated  high  on  the  LPRF  rating  criterion  (r=.36,  p<.05).  IOBC  assessees 
who  were  rated  high  on  "Structure"  were  more  apt  to  be  rated  high  on  this 
criterion  (r=.25,  p<.05).  No  other  Leader  Opinion  Questionnaire  scores 
were  significant  predictors  of  the  LPRF  for  any  assessee  group. 

Structure  was  related  to  the  OER  criterion  only  for  the  IOBC  group 
(r=.25  p<.05).  Consideration  did  not  predict  the  OER  criterion  for  any  of 
the  assessment  groups. 
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Leadership  Q-Sort 


Correlations  of  the  seven  Leadership  Q-Sort  dimensions  with  the  three 
criteria  are  presented  in  Table  24.  It  can  be  seen  that  the  IOAC  group 
provided  five  (out  of  seven)  significant  predictions  of  the  end-of-course 
grade  criterion.  For  the  other  groups  little  predictive  validity  was 
found  for  any  criterion. 

Person  Description  Blank 

Fifty  pairs  of  adjectives  were  presented  to  each  assessee  with  the 
pairs  at  the  ends  of  a  scale  from  1  to  7  (e.g.,  WARY:  1234567: 
GULLIBLE).  Instructions  were  to  rate  himself  by  circling  the  number  that 
best  described  his  position  between  these  polar  adjectives.  The  pairs 
of  adjectives  and  their  correlations  with  the  three  criteria  for  each 
assessee  group  are  presented  in  Table  25.  Positive  correlations  with  a 
leadership  criterion  indicate  that  persons  who  rated  themselves  higher 
than  average  on  the  adjective  to  the  right  of  the  scale  were  more  apt  to 
be  rated  high  on  the  criterion.  Negative  correlations  indicate  that 
persons  who  rated  themselves  higher  than  average  on  the  adjective  to  the 
left  of  the  scale  were  more  apt  to  be  rated  high  on  the  leadership 
criterion. 

COMPARISON  OF  DIFFERENT  CLASSES  OF  ASSESSMENT  CENTER  SCORES 

Data  reflecting  the  success  of  criteria  prediction  for  the  six 
different  classes  of  assessment  center  scores  are  presented  in  Table  26. 
The  much  greater  predictability  of  the  end-of-course  grade  which  typified 
data  from  all  the  various  exercises,  interviews  and  tests  is  readily 
apparent  from  this  table.  Many  of  the  classes  of  assessment  center  scores 
did  little  better  than  chance  in  predicting  the  OER  and  LPRF  leadership 
criteria. 

It  appears  from  Table  26  for  the  IOBC  and  ANCOES  assessment  groups 
that  the  pencil  and  paper  performance  test  scores  did  an  excellent  job 
of  predicting  the  OER  and  LPRF  criteria.  However,  in  both  instances 
(IOBC — OER  and  ANCOES — LPRF),  all  of  the  successful  predictors  were 
negative  correlations.  This  means  that  those  IOBC  and  ANCOES  assessees 
who  did  best  on  these  mental  performance  measures  were  apt  to  be  rated 
most  poorly  on  the  OER  (IOBC)  and  LPRF  (ANCOES).  Such  a  result  cannot  be 
considered  a  successful  criterion  prediction.  One  would  not  set  up  an 
assessment  center  with  the  intention  of  selecting  persons  who  scored 
poorly! 

The  self-description  instruments  worked  about  equally  well  for 
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TAU1.E  25 


PERSON 


PERSON  DESCRIPTION  BLANK  (PDB)  "YOURSELF"  SCORE 


PDB)  "YOURSELF"  SCORE 


TABLE  25 

PERSON  DESCRIPTION  BLANK  (PDB)  "YOURSELF"  SCORE 


TABLE  26 


predicting  all  three  criteria.  This  contrasts  with  the  other  classes  of 
assessment  center  score  which  predicted  the  end-of-course  grade  better 
than  they  predict  the  OER  and  LPRF  ratings.  However,  this  success  of  the 
self-description  instruments  for  prediction  of  the  two  leadership  ratings 
criteria  was  only  relative  to  the  other  classes  of  scores  and  only  27%  of 
these  measures  were  successful  predictors  of  the  OER  for  the  IOBC  group. 
This  was  the  highest  percentage  for  any  group  for  the  OER  and  LPRF 
criteria . 

The  self-description  measures  were  obtained  economically  and  quickly 
compared  to  the  other  classes  of  score.  Table  27  presents  the  amount  of 
assessor  time  required  to  obtain  each  score  for  each  class  of  score.  It 
can  be  seen  that  the  times  vary  from  14*5  minutes  for  each  assessor  rating 
to  .30  minutes  (18  seconds)  for  each  score  from  the  self-description 
instruments.  The  final  three  columns  of  this  table  reflect  the  average 
assessor  time  for  each  successful  predictor.  This  average  time  per 
successful  predictor  is  inversely  related  to  the  proportion  of  successful 
predictors.  Although  it  is  an  oversimplification  to  say  that  one 
successful  predictor  is  as  good  as  another,  it  can  be  seen,  that  different 
classes  of  scores  require  large  differences  in  the  amount  of  time  on  the 
part  of  assessors  (and  also  assessees)  per  successful  score. 

PREDICTION  OF  ATTRITION  IN  THE  BRANCH  IMMATERIAL  OFFICER  CANDIDATE  COURSE 

One  of  the  original  goals  of  the  USAIS  Assessment  Center  was  to  test 
the  method  as  a  means  to  improve  selection  of  BIOCC  candidates.  Of  the 
143  entering  BIOCC  students,  36  failed  to  complete  the  course  for  one 
reason  or  another.  The  "attrites"  were  assigned  a  value  of  zero  and 
successful  candidates  were  assigned  a  value  of  one.  Point-biserial 
correlations  were  calculated  between  this  dichotomous  variable  and  the 
assessment  center  measures.  Thirty  seven  of  the  196  assessment  center 
measures  (19%)  were  significantly  (p<.05)  related  to  this  attrition 
criterion.  This  compares  to  77  successful  predictors  (39%)  of  the  BIOCC 
end-of-course  grade. 

Significant  correlations  occurred  for  assessor  ratings  on  the 
following  dimensions  in  the  Radio  Simulate:  Platoon  assessor 
"adaptability"  (r=  -.15);  Battalion  assessor  "adaptability"  (r=.22); 
Platoon-assessor  "decision  making"  (r=  .14);  and  Battalion-assessor 
"decision  making"  (r=.18).  In-Basket  assessor  ratings  were  significant 
for  the  dimensions  of  "supervision"  (r=  -.18),  "sensitivity"  (r=  -.21)  and 
"task  orientation"  (r=  -.16).  Appraisal  Interview  assessor  ratings  were 
significant  for  the  dimensions  of  "planning"  (r».15)  and  "written 
organization"  (r=.14).  Assessor  retings  were  significant  on  the  Writing 
exercise  for  "grammar"  (r*.15)» 

Six  of  the  nine  assessor  ratings  for  the  Assigned  Leader  Group 
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ASSESSOR  TIME  PER  ACTR  SCORE  AND 
PER  SUCCESSFUL  PREDICTOR  OF  THE  THREE 
CRITERIA  BROKEN  DOWN  BY  CLASS  OF  SCORE 
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Exercise  were  significant  predictors  of  the  attrition  criterion.  These 
were  "leadership"  (r=.17),  "decisiveness"  (r=.17),  "motivation"  (r=.2l), 
"physical  ability"  (r=.18),  "leadership  emergence"  (r=.19),  and  "group 
facilitation"  (r=.17).  Only  four  of  these  Assigned  Leader  Group  Exercise 
measures  were  significantly  related  to  the  end-of-courae  grade  for  BIOCC 
(See  Table  15). 

Peer  rankings  in  group  exercises  significantly  predicted  attrition 
for  the  assigned  leader  group  exercise  dimensions  of  "social  association" 
(r=.15),  "leadership"  (r=.17)  and  "support  of  leader"  (r=.20).  The  peer 
ranking  on  the  dimension  of  "popularity"  on  the  Conglomerate  Exercise  was 
also  a  significant  predictor  of  the  attrition  criterion  (r=.17).  The 
highest  correlation  with  the  attrition  criterion  occurred  for  the 
self-ranking  of  "general  esprit"  on  the  Assigned  Leader  Group  Exercise 
(r=.30).  One  other  self- ranking  on  this  exercise  was  also  significantly 
correlated  with  attrition.  This  was  for  the  dimension  of  "leadership" 
(r=.l6).  The  self- ranking  of  "leadership"  on  the  Leaderless  Group 
Discussion  was  also  significantly  related  to  the  attrition  criterion 
( r=. 17) • 


For  self-description  instruments,  Edwards  Personal  Preference  Scale 
"dominance"  was  significantly  related  to  the  attrition  criterion  (r=.14), 
as  was  Leader  Opinion  Questionnaire  "Consideration"  (r=  -.20),  and 
Leadership  Q-Sort  "Personal  Integrity"  (r=.17).  Eleven  of  the  Person 
Description  Blank  "yourself"  measures  were  correlated  with  the  attrition 
criterion  and  these  are  presented  in  the  first  column  of  Table  25. 

Twenty-one  of  the  37  variables  which  showed  significant  correlations 
with  the  attrition  criterion  also  had  significant  correlations  with  the 
BIOCC  end-of-course  grade.  However,  six  of  the  21  showed  different 
relationships  with  attrition  from  those  they  showed  with  the  end-of-course 
grade.  These  were  "adaptability"  as  rated  during  the  Radio  Simulate  by 
the  "Platoon"  assessor  which  was  correlated  negatively  with  attrition 
(-.15)  but  positively  with  end-of-course  grade  (.24);  "supervision"  as 
measured  on  the  In-Basket  exercise,  which  was  correlated  -.18  with 
attrition  and  .19  with  grade;  "task  orientation",  which  was  negatively 
correlated  with  attrition  (-.16)  and  positively  with  grades  (.24);  self 
ratings  on  "sensitivity-insensitivity",  with  "insensitive"  associated  with 
avoiding  attrition  and  "sensitive”  associated  with  higher  grades;  self 
ratings  of  "careful-reckless"  with  "careful"  associated  with  avoidance  of 
attrition  and  "reckless"  associated  with  grades  (.21);  and  finally  the 
Leader  Opinion  Questionnaire  measures  of  "consideration"  associated 
negatively  with  attrition  (-.19)  and  positively  with  end-of-course  grade 
(.24).  These  six  pairs  of  opposite-direction  correlations  indicate  a 
"Catch-22"  situation  where  a  performance  or  attitude  that  aids  in 
achieving  a  high  course  grade  actually  increases  the  chance  of  attrition. 
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ASSESSEE/ MATCH  DIFFERENCES  IN  FIELD  LEADERSHIP  RATINGS 

The  IOAC  and  ANCOES  assessees  received  feedback  on  their  assessment 
center  performance  including  recommendations  for  self-improvement.  These 
IOAC  and  ANCOES  assessees  were  matched  with  other  students  in  their 
classes  who  did  not  participate  in  the  assessment  center. 

The  matched  control  group  was  included  to  allow  a  test  of  the  amount 
of  development  that  occurred  as  a  result  of  assessment  and  feedback  of  the 
assessment  results.  The  return  rate  of  about  one  half  of  the  Leadership 
Performance  Rating  Forms  produced  only  one  quarter  of  the  data  for  matched 
pairs.  Of  these  44  pairs  for  whom  data  were  available,  the  average 
overall  rating  for  the  assessees  was  5-13  and  for  the  matched  controls 
5.01.  This  difference  was  not  significant  (F(l ,86)  =.90;  p=.35). 

When  data  for  all  assessees  and  for  all  controls  were  considered, 
irrespective  of  whether  assessee-match  pairs  existed,  average  ratings  were 
actually  slightly  higher  for  the  matched  controls.  This  also  provided  no 
support  for  development  of  leadership  as  a  result  of  the  assessment  and 
feedback  of  results. 

LPRF  ratings  were  poorly  predicted  by  the  data  from  the  assessment 
center.  In  light  of  this,  the  above  finding  that  assessees  showed  no 
difference  from  matched  controls  on  this  leadership  criterion  is  not 
surprising.  Leadership  development  may  have  actually  occurred  through 
assessment  and  feedback,  but  may  not  have  been  reflected  in  a  "poor" 
criterion  of  leadership.  Since  the  end-of-cour3e  grade  was  much  more 
strongly  predicted  by  assessment  center  data,  it  may  be  that  any 
development  that  occurred  in  the  assessment  center  and  following  feedback 
of  assessment  center  results  would  also  be  reflected  in  end-of-course 
grade  performance. 

Unlike  the  data  from  the  Leadership  Performance  Rating  Form  ratings 
provided  by  superiors,  peers  and  subordinates,  nearly  complete 
end-of-course  grade  data  were  available.  Mean  course  grade  for  the  IOAC 
assessees  was  841.2  and  for  the  matched  controls  this  was  849-4.  The 
difference  was  not  significant,  but  it  was  in  the  opposite  direction  from 
that  predicted  if  leadership  development  had  occurred  in  the  IOAC 
assessees.  A  similar  reversal  was  found  for  the  ANCOES  course  grade. 
ANCOES  assessees  had  an  average  end-of-course  grade  of  812.4  vs.  821.7  for 
the  matched  controls. 


DISCUSSION 

The  data  from  the  USAIS  Assessment  Center  were  not  successful  in 
predicting  the  originally  planned  criterion  of  leadership,  which  involved 
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superior,  peer  and  subordinate  ratings  made  six-  and  18-months  following 
completion  of  leadership  training  and  assignment  to  units.  Only  data 
provided  from  self-description  instruments  did  much  better  than  chance  in 
predicting  these  leadership  ratings  and  they  represented  only  an 
incidental  effort  in  the  assessment  center.  This  failure  of  the 
assessment  center  to  predict  the  planned  leadership  criterion  may  have 
resulted  from  the  fact  that  leadership  displayed  in  the  USAIS  assessment 
center  did  not  correspond  to  the  leadership  displayed  in  the  peacetime 
garrison  settings  where  these  officers  and  NCOs  were  assigned. 
Alternatively,  trained  assessors  in  the  assessment  center  may  have 
responded  to  different  leader  behaviors  than  did  the  superiors,  peers  and 
subordinates  of  the  assessees  in  the  field  who  lacked  formal  training  in 
leadership  assessment.  The  failure  of  assessor  ratings  to  correlate  with 
field  leadership  ratings  held  for  both  the  combat/emergency  simulations 
and  also  for  the  simulations  of  garrison  tasks  ( In-Basket,  Appraisal 
Interview,  Leaderless  Group  Discussion).  The  peace-time  environment  of 
the  field  leadership  ratings  and  OERs  does  not  explain  the  failure  of  the 
assessment  center  data  from  garrison  tasks  to  predict  these  field 
leadership  ratings  and  CERs.  This  could  be  a  factor  in  the  failure  of 
combat/emergency  simulations. 

No  validation  of  the  Leadership  Performance  Rating  Form  criterion  had 
occurred  prior  to  its  use  and  since  the  criterion  measure  could  have  been 
defective,  additional  criteria  of  leadership  were  related  to  the 
assessment  center  data.  All  assessees  immediately  attended  a  leadership 
course,  and  the  final  grade  of  this  course  was  found  to  be  predicted  by  a 
majority  of  the  assessor  ratings.  This  success  reinforced  interrater 
reliability  measures  in  indicating  the  reliability  of  the  primary 
assessment  center  data  which  are  assessor  ratings.  The  negative  side  of 
this  success  is  that  it  might  indicate  that  the  simulations  of  job  tasks 
used  in  the  assessment  center  were  "academic"  and  not  true  simulations  of 
job  situations. 

Permission  and  assistance  were  obtained  from  the  Military  Personnel 
Center  to  relate  Officer  Evaluation  Report  Ratings,  which  are  critical  to 
officer  advancement,  to  the  assessment  center  data.  It  was  feared 
initially  that  these  scores  would  not  be  reliable  due  to  the  well  known 
tendency  to  give  only  very  high  scores.  However,  sufficient 
variance/ reliability  existed  to  provide  substantial  correlations  between 
OERs  from  different  years.  These  OERs  also  showed  significant 
correlations  with  the  LPRF  field  leadership  criterion,  and,  as  this 
correlation  suggests,  the  OERs  showed  a  similar  lack  of  relationship  to 
the  assessment  center  data  as  was  shown  by  the  LPRF.  The  new  revision  of 
the  OER  indicates  that  personnel  specialists  hold  some  doubt  about  the 
validity  of  the  OER  measure  and  the  failure  of  the  assessment  center  to 
predict  this  OER  criterion  should  probably  not  be  used  as  an  indictment  of 
the  USAIS  Assessment  Center,  either. 


Although  BIOCC  course  grades  were  fairly  well  predicted  by  the 
assessment  center  data,  less  success  occurred  for  prediction  of  BIOCC 
attrition.  Generally  the  significant  predictors  of  attrition  were  also 
significant  predictors  of  the  course  grade.  However,  some  predictors 
provided  significant  positive  correlations  with  grades  and  negative 
correlations  with  attrition  and  vice  versa .  This  suggests  that  to  survive 
in  BIOCC  and  to  do  well  in  BIOCC  are  somewhat  in  conflict. 

The  final  goal  of  the  assessment  center  was  to  provide  leadership 
development  through  identification  of  weaknesses  and  prescription  of 
training  to  overcome  them.  However,  no  differences  between  assessees  and 
matched  controls  were  shown  for  the  LPRF  ratings  of  leadership  nor  were 
there  any  differences  in  leadership  course  grades.  On  the  other  hand, 
acceptance  by  assessees  of  the  assessment  center  testing  was  high  (Smith, 
1978),  and  they  invariably  reported  that  it  had  accurately  identified 
their  leadership  weaknesses.  The  problem  may  have  been  that  no  strong 
inducement  or  opportunity  was  given  to  follow  the  individual  prescriptions 
made  for  leadership  development. 

None  of  the  initial  hopes  of  the  USAIS  Assessment  Center  were  borne 
out  by  data  collected  in  this  validation  research.  This  was  true  despite 
high  reliability  of  both  the  assessment  center  data  and  the  criterion 
measures.  The  one  area  of  success  was  prediction  of  leadership  course 
performance  and  this  was  not  an  original  objective.  This  success, 
however,  could  itself  indicate  that  the  assessment  center  exercises 
elicited  largely  academic  skills  which  may  not  have  particular  relevance 
to  field  leadership.  On  the  other  hand,  evidence  exists  that  field 
leadership  ratings  and  OERs  themselves  were  deficient  leadership  criteria. 
For  example,  significant  negative  correlations  between  NCO  academic 
performance  and  field  leadership  ratings  and  between  NCO  "IQ"  measures  and 
field  leadership  ratings  indicate  that  quality  of  performance  may  not  be 
recognized  and/or  appreciated  in  the  field. 

A  future  validation  of  the  USAIS  assessment  center  will  be  conducted 
as  soon  as  the  new  Officer  Evaluation  Rating  system  provides  criterion 
data  on  all  of  the  officer  assessees  who  remain  in  the  Army.  This  will 
also  allow  an  assessment  of  the  relationship  between  the  old  OERs  and  the 
nex  OERs.  Finally,  a  ten-year  validation  of  the  assessment  center  is 
planned  which  will  use  promotion  as  the  leadership  criterion.  Leadership 
course  grades  will  also  be  validated  against  promotion. 

No  dramatic  difference  from  the  current  negative  results  is 
anticipated  from  either  of  those  validations.  However,  the  huge 
expenditure  of  personnel  and  resources  to  obtain  the  original  assessment 
center  data,  the  reliability  of  that  data  and  the  auxiliary  questions  that 
the  studies  will  answer  justify  the  additional  follow-up  efforts. 
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APPENDIX  A 


PERSON  DESCRIPTION  BLANK 


Name _ _ _ 

Roster  #  _ 

Date _ 

(day)  (month)  (year) 

On  the  following  pages  are  listed  a  number  of  word  pairs.  Each  wo.rd  in 
the  pair  forms  one  end  of  the  dimension  they  represent.  These  dimen¬ 
sions  will  be  used  to  describe  several  persons.  Between  the  words  are 
seven  numbered  spaces.  For  example: 

Capable  1  :  2  :  3  :  '4‘ :  5  :  6  :  7  Incapable 

The  numbers  between  the  adjectives  do  not  represent  scores.  They  sim¬ 
ply  identify  the  space  and  are  used  to  Indicate  where  you  should  mark 
the  answer  sheet.  Basically  each  scale  is  used  as  follows.  The  more 
you  think  one  of  the  words  applies  to  the  man  you  are  describing,  the 
closer  the  number  you  circle  should  be  to  that  word.  For  example  if  the 
person  you  are  describing  is  very  capable  you  would  circle  number  one  on 
the  scale  above.  If  he  is  quite  capable  you  would  mark  2,  only  a  little 
capable  3.  If  neither  word  describes  him  or  if  both  seem  equally  appli¬ 
cable  you  would  circle  number  4. 

Remember  the  numbers  have  no  meaning  as  numbers.  The  closer  the  number 
you  circle  is  to  a  word  the  better  you  think  that  word  describes  the 
person. 

If  the  person  being  described  were:  extremely  confident,  only  slightly 
thoughtful  and  moderately  decisive,  you  might  mark  these  three  scales  as 
shown  below. 

Unsure  1  :  2  :  3  :  4  :  5  :  6  : Q  Confident 

Thoughtful  1:2:(^):4:5:6:7  Thoughtless 

Decisive  1  :  (2) :  3  :  4  :  5  :  6  :  7  Undecisive 

Another  man  is  slightly  unsure  of  himself,  neither  particularly  thought¬ 
ful  nor  thoughtless,  and  is  fairly  or  moderately  Indecisive.  Mark  the 
scales  below  to  describe  him. 

Unsure  1:2:3:4:5:6:7  Confident 

Thoughtful  1:2:3:4:5:6:7  Thoughtless 

Decisive  1:2:3:4:5:6:7  Indecisive 

When  you  have  marked  these  scales  wait  for  further  instructions. 


FORM  C 
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Yourself 


1.  Persuasive 

2.  Mon  competitive 

1  :  2 

1  :  2 

3:4: 

3  :  4 

5 

5 

6  :  7 

6  :  7 

Unpersuasive 

Competitive 

3. 

Clumsy 

1  s  2 

3  :  4 

5 

6  :  7 

Graceful 

4. 

Understandable 

1  :  2 

3  :  4 

5 

6  :  7 

Mysterious 

5. 

Clever 

1  :  2 

3  :  4 

5 

6  :  7 

Dull 

6. 

Capable 

1  :  2 

3  :  4 

5 

6  :  7 

Incapable 

7. 

Smooth 

1  :  2 

3  :  4 

5 

6  :  7 

Rough 

8. 

Cooperative 

1  :  2 

3  :  4 

5 

6  :  7 

Uncooperative 

9. 

Insensitive 

1  :  2 

3  :  4 

5 

6  s  7 

Sensitive 

10. 

Confident' 

1  :  2 

3  :  4 

5 

6  :  I 

Unsure 

11. 

Flexible 

1  :  2 

3  :  4 

5 

6  :  7 

Rigid 

12. 

Plodding 

1  :  2 

3  :  4 

5 

6  :  7 

Brilliant 

13. 

Tactful 

1  :  2 

3  :  4 

5 

6  :  7 

Blunt 

14. 

Optimistic 

1  :  2 

3  :  4 

5 

6  :  7 

Pessimistic 

15. 

Yielding 

1  :  2 

3  :  4 

5 

6  :  7 

Firm 

16. 

Tough 

1  :  2 

3  :  4 

5 

6  s  7 

Tender 

17. 

Military 

1  :  2 

3  :  4 

5 

6  :  7 

Unmilltary 

18. 

Thoughtless 

1  :  2 

3  :  4 

5 

6  :  7 

Thoughtful 

19. 

Wary 

1  :  2 

3  :  4 

5 

6  :  7 

Gullible 

20. 

Weak 

1  :  2 

3  :  4 

5 

6  ;  7 

Strong 

21. 

Slow 

1  :  2 

3  :  4 

5 

6  :  7 

Fast 

22. 

Indecisive 

1  :  2 

3  :  4 

5 

6  :  7 

Decisive 

23. 

Unintelligent 

1  :  2 

3  :  4 

5 

6  :  7 

Intelligent 

24. 

Methodical 

1  :  2 

3  :  4 

5 

6  :  7 

Creative 

25. 

Careful 

1  :  2 

:  3  :  4 

5 

:  6  s  7 

Reckless 

Yourself 

(Continued) 


26. 

Funny 

1 

27. 

Cowardly 

1 

28. 

Insincere 

1 

29. 

Leading 

1 

30. 

Shortsighted 

1 

31. 

Passive 

1 

32. 

Soothing 

1 

33. 

Mild 

1 

34. 

Undisciplined 

1 

35. 

Timid 

1 

36. 

Ambitious 

1 

37. 

Suspicious 

1 

38. 

Boring 

1 

39. 

Quiet 

1 

40. 

Give  up  easily 

1 

41. 

Secretive 

1 

42. 

Mission-oriented 

1 

43. 

Colorful 

1 

44. 

Hardworking 

1 

45. 

Dominating 

1 

46. 

Stable 

1 

47. 

Complex 

1 

48. 

Unathletic 

1 

49. 

Disorganized 

1 

50. 

Friendly 

1 

2  :  3  :  4  :  5  :  6 
2  :  3  :  4  :  5  :  6 
2  :  3  :  4  :  5  :  6 

2  :  3  s  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  s  3  ;  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  ;  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  s  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  s  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 

2  :  3  :  4  :  5  :  6 
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7  Sober 
7  Brave 
7  Sincere 
7  Following 
7  Farsighted 
7  Active 
7  Irritating 
7  Forceful 
7  Disciplined 
7  Bold 
7  Complacent 
7  Trusting 
7  Interesting 
7  Talkative 
7  Persistent 
7  Open 

7  People-oriented 
7  Colorless 
7  Easy  going 
7  Submissive 
7  Changeable 
7  Simple 
7  Athletic 
7  Organised 
7  Distant 


The  Average  Captain 


1.  Persuasive  1:2:3 

2.  Non  competitive  1:2:3 

3.  Cluasy  1:2:3 

4.  Understandable  1:2:3 

5.  Clever  1:2:3 

6.  Capable  1:2:3 

7.  Smooth  1:2:3 

8.  Cooperative  1:2:3 

9.  Insensitive  1:2:3 

10.  Confident  1:2:3 

11.  Flexible  1:2:3 

12.  Plodding  1:2:3 

13.  Tactful  1:2:3 

14.  Optimistic  1:2:3 

15.  Yielding  1:2:3 

16.  Tough  1:2:3 

17.  Military  1:2:3 

18.  Thoughtless  1:2:3 

19.  Wary  1:2:3 

20.  Weak  1:2:3 

21.  Slow  1:2:3 

22.  Indecisive  1:2:3 

23.  Unintelligent  1:2:3 

24.  Methodical  1:2:3 

25.  Careful  1:2:3 


4  :  5  :  6  :  7  Unpersuasive 

4  :  5  ;  6  :  7  Competitive 

4  :  5  :  6  :  7  Graceful 

4  :  5  :  6  :  7  Mysterious 

4  :  5  :  6  :  7  Dull 

4  :  5  :  6  :  7  Incapable 

4  :  5  :  6  :  7  Rough 

4  :  5  :  6  :  7  Uncooperative 

4  :  5  :  6  :  7  Sensitive 

4  :  5  :  6  :  7  Unsure 

4  :  5  :  6  :  7  Rigid 

4  :  5  :  6  :  7  Brilliant 

4  :  5  :  6  :  7  Blunt 

4  :  5  :  6  :  7  Pessimistic 

4  :  5  :  6  :  7  Firm 

4  :  5  :  6  :  7  Tender 

4  :  5  :  6  :  7  Unmilitary 

4  :  5  :  6  :  7  Thoughtful 

4  :  5  :  6  :  7  Gullible 

4  :  5  :  6  :  7  Strong 

4  :  5  :  6  :  7  Fast 

4  :  5  :  6  :  7  Decisive 

4  :  5  :  6  :  7  Intelligent 

4  :  5  :  6  :  7  Creative 

4  :  5  :  6  :  7  Reckless 
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The  Average  Captain 
(Continued) 


26. 

Funny 

1 

27. 

■  Cowardly 

1 

28. 

Insincere 

1 

29. 

Leading 

1 

30. 

Shortsighted 

1 

31. 

Passive 

1 

32. 

Soothing 

1 

33. 

Mild 

1 

34. 

Undisciplined 

1 

35. 

Timid 

1 

36. 

Ambitious 

1 

37. 

Suspicious 

1 

38. 

Boring 

1 

39. 

Quiet 

1 

40, 

Give  up  easily 

1 

41. 

Secretive 

1 

42. 

Klaslon-orlented 

1 

43. 

Colorful 

1 

44. 

Hardworking 

1 

45. 

Dominating 

1 

46. 

Stable 

1 

47. 

Complex 

1 

48. 

Unathletlc 

1 

49. 

Disorganised 

1 

50. 

Friendly 

1 

2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  j  3 
2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  ;  3 
2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  :  3 
2  t  3 
2  ;  3 
2  :  3 
2  :  3 
2  :  3 


4  :  5  :  6  :  7 

4  s  5  s  6  :  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  s  6  :  7 

4  :  5  s  6  :  7 

4  t  5  :  6  s  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  :  6  s  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  ;  6  :  7 

4  :  3  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 

4  :  5  »  6  t  7 

4  :  5  :  6  t  7 

4  :  5  :  6  :  7 

4  :  5  :  6  :  7 


Sober 

Brave 

Sincere 

Following 

Farsighted 

Active 

Irritating 

Forceful 

Disciplined 

Bold 

Complacent 

Trusting 

Interesting 

Talkative 

Persistent 

Open 

People-oriented 

Colorless 

Easy  going 

Submissive 

Changeable 

Simple 

Athletic 

Organised 

Distant 


The  Ideal  Captain 


1. 

Persuasive 

1 

2. 

Mon  competitive 

1 

3. 

Cluaisy 

1 

4. 

Understandable 

1 

5. 

Clever 

1 

6. 

Capable 

1 

7. 

Smooth 

1 

8. 

Cooperative 

1 

9. 

Insensitive 

1 

10. 

Confident 

1 

11. 

Flexible 

1 

12. 

Plodding 

1 

13. 

Tactful 

1 

14. 

Optimistic 

1 

15. 

Yielding 

1 

16. 

Tough 

1 

17. 

Military 

1 

18. 

Thoughtless 

1 

19. 

Wary 

1 

20. 

Vcak 

1 

21. 

Slow 

1 

22. 

Indecisive 

1 

23. 

Unintelligent 

1 

24. 

Methodical 

1 

25. 

Careful 

1 

2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  :  3  s  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  s  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  ;  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  ; 

2  .*  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  s  6  ; 

2  :  3  :  4  :  5  :  6  : 
2  j  3  :  4  s  5  :  6  s 
2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  :  3  :  4  :  5  :  6  : 
2  s  3  :  4  :  5  :  6  s 
2:3:4:5:6s 


7  Unpersuaaive 
7  Competitive 
7  Graceful 
7  Mysterious 
7  Dull 
7  Incapable 
7  Rough 

7  Uncooperative 
7  Sensitive 
7  Unsure 
7  Rigid 
7  Brilliant 
7  Blunt 
7  Pessimistic 
7  Fir* 

7  Tender 
7  Unmllltary 
7  Thoughtful 
7  Gullible 
7  Strong 
7  Fast 
7  Decisive 
7  Intelligent 
7  Creative 
7  Reckless 
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ns 


26. 

Funny 

1 

27. 

Cowardly 

1 

28. 

Insincere 

1 

29. 

Leading 

1 

30. 

Shortsighted 

1 

31. 

Passive 

1 

32. 

Soothing 

1 

33. 

Mild 

1 

34. 

Undisciplined 

1 

35. 

Timid 

1 

36. 

Ambitious 

1 

37. 

Suspicious 

1 

38. 

Boring 

1 

39. 

Quiet 

1 

40. 

Give  up  eeslly 

1 

41. 

Secretive 

1 

42. 

Mis a lon-orient  ed 

1 

43. 

Colorful 

1 

44. 

Hardworking 

1 

45. 

Dominating 

* 

1 

46. 

'  _  /  Stable 

1 

47. 

Complex 

1 

48. 

Unathletic 

1 

49. 

Disorganised 

1 

50. 

Friendly 

1 

The  Ideal  Captain 
(Continued) 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  t  6  : 

2  :  3  :  4  :  5  :  6  : 

2  s  3  :  4  :  5  :  6  : 

2  ;  3  :  4  :  5  :  6  s 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  s 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  s  5  s  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  :  4  :  5  :  6  : 

2  :  3  s  4  :  5  :  6  : 

2  s  3  :  4  :  5  s  6  : 

2  :  3  :  4  :  3  :  6  : 

2  i  3  :  4  :  5  :  6  t 


7  Sober 
7  Brave 
7  Sincere 
7  Following 
7  Fare lgh ted 
7  Active 
7  Irritating 
7  Forceful 
7  Disciplined 
7  Bold 
7  Complacent 
7  Trusting 
7  Interesting 
7  Talkative 
7  Persistent 
7  Open 

7  People-oriented 
7  Colorless 
7  Easy  going 
7  Submissive 
7  Changeable 
7  Simple 
7  Athletic 
7  Organised 
7  Distant 
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June  197** 


ntroclueLion 


As  a  part  of  an  important,  long-range  research  project,  the  U.S. 

Amy  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI) 
is  evaluating  the  Army's  training  efforts  in  the  areas  of  personnel 
management,  training  management,  leadership  principles,  and  oral  and 
written  communication.  Your  responses  to  the  rating  scales  on  the 
following  pages  are  a  kev  part  of  this  research  effort. 

Your  ratings  will  be  maintained  in  the  strictest  confidence.  They 
will  not  be  released  to  anyone  in  your  chain  of  command.  They  will 
not  become  a  part  cf  any  official  file.  All  reports  will  be  based 
on  averages  and  no  individual  responses  will  be  Identifiable.  Please 
be  honest  in  your  responses.  In  that  way,  you  can  be  of  the  greatest 
help  in  improving  training.  - 

1.  Your  identification. 


SSAN _ 

Name  _ _ _ 

Last  First  HI 


Signature  _ 

YOU  APE  TO  RATE  THE  LEADER  IDENTIFIED  BELOW: 

2.  How  frequently  do  you  have  direct  contact  with  the  leader  you  are 
to  rate?  (Check  one) 

(1)  _ Every  working  day 

(2)  _ 1-4  rimes  each  week 

(3)  _ Once  a  week  on  the.  average 

(4)  _ 1-3  !. ieius  each  month 

(5)  _ Once  a  t.onth  on  the  average 


3.  How  long  have  you  known  the  leader  you  are  to  rate? 

a.  During  his  present  assignment;  _ months 

b.  During  one  or  several  previous  assignments; 

_ years 

_ months 

(Write  in  zeros  if  you  have  had  no  previous  contact.) 


NOTE:  When  you  have  completed  this  document,  place  it  in  the 
envelope  provided,  and  mail  it.  Thank  you  for  your 
cooperation. 


71 


LEADER  PERFORMANCE  FATING  FORM 


Instructions 


You  are  being  asked  to  rate  this  leader's  level  of  effectiveness  in  per¬ 
forming  50  separate  leadership  activities.  As  a  superior,  peer,  or 
subordinate  of  this  leader,  you  will  have  had  ample  opportunity  to  form 
a  judgment  about  this  leader's  effectiveness  in  performing  most  of  the 
actions  which  appear  on  the  list.  However,  for  some  of  the  actions,  you 
will  not  have  had  an  opportunity  to  directly  observe  this  leader's  per¬ 
formance  of  the  action  during  the  period  of  your  association  with  him. 

For  these  actions,  your  Judgments  will  have  to  be  based  upon,  your  direct 
observation  of  other  highly  related  actions,  and  not  on  observation  of 
the  action  itself. 

Repeat  the  follow!-'*  steps  for  each  action  listed.  First,  read  the 
description  of  the  action  and  recall  occasions  on  which  this  leader 
performed  the  action  and  occasions  (if  any)  on  which  the  action  should 
have  been  performed  but  was  not.  'ext,  form  a  conclusion  about  the 
leader's  level  of  effectiveness  in  regard  to  this  action.  Your  judgment 
wou.' d  be  that  he  shows  very  high  effectiveness  if  he  performs  the  action 
a  high  percentage  of  the  times  when  the  action  is  required  and  performs 
at  a  quality  level  which  greatly  exceeds  the  standard  or  acceptable  level. 
Your  judgment  would  be  that  he  shows  very  low  effectiveness  if  the  leader 
falls  to  perform  the  action  when  it  is  required  or  performs  it  at  a 
quality  level  which  falls  below  the  standard  or  acceptable  level.  When 
you  have  formed  a  judgment  about  the  leader's  level  of  effectiveness  in 
performing  this  action,  write  a  performance  score  for  that  action  in  the 
snace  provided,  based  on  the  scale  of  values  defined  below.  Circle  the 
appropriate  number  directly  opposite  the  action  in  the  last  column.  Then 
proceed  to  the  next  action  and  repeat  these  steps. 


Performance  Score: 


Description 

Score 

Values 

L 

Interpretation 

OUTSTANDING 

6 

This  leader  performs  this  action  at  an  effective¬ 
ness  level  which  is  outstanding  compared  to  what 
you  would  consider  an  acceptable  performance. 

SUPERIOR 

5 

This  leader  performs  this  action  at  an  effective¬ 
ness  level  which  is  much  higher  than  the 
accentsble  level,  but  not  auite  outstanding. 

EXCELLENT 

4 

This  leader  performs  this  action  at  an  effective¬ 
ness  level  which  is  more  than  acceptable 
(but  not  superior) . 

EFFECTIVE 

3 

This  leader  performs  this  action  at  an  effective¬ 
ness  level  which  is  acceptable  on  the 
average. 

MARGINAL 

2 

This  leader  performs  this  action  at  an  effective¬ 
ness  level  which  does  not  meet  the  minimum 
acceptable  level. 

INADEQUATE 

1 

This  leader  performs  this  action  at  an  effective¬ 
ness  level  which  is  much  lower  than  the  minimum 
acceptable  level. 

Performance  Score; 


Outetandl 


Superior  Excellent  Effective  Marginal  Inadequate 


5 


Action 


Applying  current  doctrine  to  solutlona  of  tactical 
and  technical  problems . . . 


Defending  viewpoints  tactfully  when  others  (superiors, 
peers,  subordinates)  disagree  with  him  ........ 


Coordinating  the  activities  of  individuals  and  teams 

Taking  action  on  hla  own  initiative  whenever  higher 
directives  cannot  or  should  not  be  obtained  . 


(Circle) 


01:  1  2  3  A  5  6 


02:  123456 


03:  123456 


04:  123*56 


Approaching  new  tasks  with  enthusiasm  .  .05:  123456 


Making  decisions  at  the  time  at  whlci.  they  are 
required  .....  .  ....... 


Supplying  subordinates  with  information  needed  by 
them  in  order  to  complete  assigned  tasks  . 


06:  123456 


0?:  :  2  3  4  5  6 


Clearly  presenting  all  the  points  he  intends  to  make 
when  talking  to  others  . 


Using  different  leadership  styles  appropriate  to 
specific  situations  . 


08.  153456 


09:  123456 


Reporting  all  Important  information  to  his  superlor(s)  .1  10:  123456 


Maintaining  consistency  in  the  way  he  administers 
the  rewards  and  punishments  within  his  authority  . 


11:  123456 


Expressing  interest  in  others  .  12:  123456 


Reaching  the  most  suitable  conclusion  in  view  of 
existing  conditions  .  . 


Using  language  appropriate  to  his  listener (s)  . 

Supporting  the  needs  of  his  peers  and  subordinates 
when  dealing  with  superiors  . 


Allocating  his  personal  time  to  different  tasks 
according  to  their  priorities  . 


13:  123456 


14:  123456 


15:  123456 


16:  123456 
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Performance  Score: 


Outstanding  Superior  Excellent  Effective  Marginal 
6  5  4  3  2 


Action 


17:  Overcoming  barriers  to  task  accomplishment  . 

18:  Maintaining  confidence  in  himself  .  . 

19:  Maintaining  adequate  performance  of  his  duties 
throughout  periods  of  stress 

20:  Knowing  the  operating  characteristics  and  maintenance 
needs  of  the  equipment,  materiel,  and  facilities  under 
his  responsibility . . . 

21:  Varying  his  approach  to  different  individuals  according 
to  their  unique  char irteri Stic s  . 

22:  Determining  whether  a  pe:fo-mance  failure  by  a  sub¬ 
ordinate  was  caused  by  lack  of  ability,  lack  of 
motivation,  or  factors  beyond  the  so'.  .  rdinate  '  t 

control  . 

23:  Displaying  a  working  knowledge  of  tr:t  duties  perf^r^ed 
by  his  immediate  superior  (...) . 

24:  Maintaining  poise  in  situations  where  conflicting 

demands  are  placed  on  him  by  superiors,  subordinates, 
and/or  task  requirements  . 

25:  Using  appropriate  grammar  and  sentence  structure  in 

oral  and  written  communication  . 

26:  Taking  all  available  information  into  account  in 

reaching  a  decision  .  . 

27:  Using  most  of  his  time  in  work-related  activities  .  .  . 

28:  Delegating  certain  decisions  to  subordinates  who  arc- 

competent  to  make  these  decisions  . 

29:  Maintaining  a  high  energy  output  throughout  combat 

or  training  operations  . 

30:  Supporting  the  actions  or  policies  of  his  superiors 

when  communicating  downward  . 


Inadequate 

1 


Score 

(Circle) 

FOR 

ADP 

USE 

17:  123456 

44 

18:  123456 

45 

19:  123456 

46 

20:  123456 

47 

21:  1  2  3  '4  3  6 

48 

22:  12345b 

49 

23:  123456 

50 

24:  123456 

51 

25:  123456 

52 

2b :  123456 

53 

27:  123456 

54 

28:  123456 

55 

29:  123456 

56 

30:  123456 

57 
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Performance  Score : 


Outstanding 


6 


Superior  Excellent  Effective  Marginal  Inadequate 


5  4  3  2  1 


Action 


Displaying  the  skills  necessary  to  use  equipment, 
materiel,  or  facilities  normally  required  for 
performance  in  his  position  . 


Score 

(Circle) 


Maintaining  firmness  on  a  decision  ess  new 
information  is  received  . 


Covering  details  in  written  and  oral  commur.  teat  ions 

without  rambling  or  clouding  ol'  issues . 33:  12  3 

Persuading  either  superiors  or  subordinate.;  to  modify 
their  expectations  when  the  two  groups  are  making 

conflicting  demands  .  34:  123 

Diagnosing  the  critical  aspects  of  any  problem  situation 
which  must  be  accounted  for  ir.  the  final  decision  .  .  .  35:  12  3 

Creating  a  complete  plan  for  implementing  a  decision 
which  also  accounts  for  any  possible  unwanted  side 
effects  of  the  decision  . .  36:  1  2  3  4  5  6 


Changing  his  approach  when  significant  changes  in 
the  situation  occur  . 


37:  123456 


Seeking  others'  opinions  and  viewpoints  .  38:  123456 

Maintaining  high  internal  standards  for  the  quality 

and  quantity  of  work  he  achieves .  39:  123456 


Informing  subordinates  of  the  performance  standards 
which  will  be  acceptable  when  assigning  tasks  .  .  . 


Accepting  responsibility  for  his  own  actions 


Expanding  the  range  of  tasks  ne  can  accomplish  or 
skills  he  can  exercise  . 


1  2  3  4  5  6 


1  2  3  4  5  6 


Displaying  a  working  knowledge  of  the  skills  required 
by  unit  positions  subordinate  to  his  own  . 


Maintaining  attention  when  others  attempt  to 
communicate  with  him  . 


Performance  Score: 


Outstanding  Suoerior  Excellent  Effective  Marginal  Inadequate 


6  5  4  3  2  1 


Action 


Score 

(Circle) 


45:  Determining  the  appropriate  sequence  for  intermediate 

tasks  or  goals .  45:  1  2  3  4  5  6 


46:  Getting  others  to  change  their  behavior  without 


coercion 


46:  123456 


47:  Developing  the  skills  of  a  subordinate  through  a 

constructive  critique  of  his  performance  .  47:  123456 

48:  Modifying  his  behavior  on  the  basis  of  valid  construc¬ 
tive  criticism  .  48:  123456 


49:  Considering  a  wide  range  of  alternative  solutions  to 

a  problem  .  49:  123456 

50:  Supporting  subordinate  leaders  .  50:  123456 


1.  How  long  have  you  known  the  leader  you  have  just  rated? 

a.  During  his  present  assignment;  _ months. 

b.  During  one  ir  several  previous  assignments;  _ months. 

2.  How  much  opportunity  have  you  had  to  observe  the  performance 
of  the  leader  you  have  just  rated?  (Check  one) 

_  Quite  a  bit 

_  Some 

_  Not  very  much 

Note:  Place  this  completed  document  in  the  envelope  provided  when  you  have 
completed  it.  Thc-.ik  you  for  your  cooperation. 
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Nr  «w  W  tfcfc  farm.  M *16-1 OS ; 

N  pnpMtRl  fancy  k  Ik*  M|uS— t  Otnnfi  OMm 


PACT  I  -  FftSONAi  DATA  (Rea*  paragraph  3-2a  AR  623-105) 


-  FAST  NAMl  -  MK)OU  INITIAL 


«  UNIT. ORGANIZATION.  STATION  AND  MAJOR  COMMAND 


mmm 


WM4CI  I  '  mb  m  Ml 


$P  CARfflt 
PROG  COO€ 


PART  ■  -  RVOCflMO  PHIOfi  AMO  DUTY  DATA  ( Read  paragraph  3-2*.  AR  623-105 ) 


Penod  Covered 


H _ 

— Jv— — it— ■mnwia  .  fwv.'rrrru'j— 

i  1 1 '  ■■  n 

f£*r.  * .  **  Aft#'  i  •■' ■'  I  'iMIl'llfi  "f  *: 


d.  IXPIANATION  Of  NONAATIO  DUTY  OAY$  AND/OR  OtHf 9  DAYS  (As  Required) 


b.  Reason  for  Submitting  Rcpon 


Repon  Based  On 


a  Principal  Duty  Title _ 

d  Special  Career  Program  Position  Designation  . 


PACT  rn  -  OCSCMPTIOM  OP  OUTSS  (R  tad  paragraph  4-3d,  AR  623- 105  ) 


_  b  Duty  MOS 

—  ■  t.  Description 


c.  Auth  Grade 


PACT  N  -  PCOPCSMONAl  ATTMUTB  (Read paragraph  4-3 f.  AR  6 23-105 ) 


a  RATfR  Complete  each  question.  Explain  *  No  and  *  Needs  improvement  responses  in  Part  IVb  and.  if  necessary.  Pari  VII . 


I  Has  this  officer  demonstrated  moral  and  character  strength0 


2.  Did  this  officer  demonstrate  technical  competence  appropriate  to  his  grade  and  branch? 


3.  Did  this  officer  state,  as  appropriate,  his  honest  opinions  and  convictions?  (Not  a  “yes  man"! 


4  Did  i his  officer  seek  responsibility0 


5.  Did  this  officer  willingly  accept  full  accountability  for  his  actions  and  the  actions  of  his  subordinates0 


6  Is  this  officer  emotionally  stable  under  stress? 


7  Is  this  officer's  judgment  reliable7 

8.  Did  this  officer  maintain  effective  two-way  communication  with  juniors,  seniors,  and  peers? 
9  Did  this  officer  demonstrate  concern  for  the  best  interests  of  his  subordinates'1 


10  Did  this  officer  contribute  to  the  persona)  and  professional  development  of  his  subordinates? 


1 1.  Did  this  officer  subordinate  his  personal  interests  and  welfare  to  those  of  his  organization  and  subordinates? 


J2.  Did  this  officer  s  personal  conduct  set  the  proper  example  for  his  subordinates? 


13  Was  this  officer  innovative  in  his  approach  to  his  duties  and  responsibilities? 


14  Did  this  officer  demonstrate  a  breadth  of  perspective  and  depth  of  understanding  beyond  the  limit  of  his  specific  responsibilities0 


15.  Did  this  officer  keep  himself  physically  fit? 


16.  Did  this  officer  fulfill  his  responsibilities  concerning  the  Army's  Equal  Opportunity  Program? 


b  RATfR  Explanation  Question*  s) 


*NttDS 

TO  IMADOVfMfNT  *NO 


I  ■■■ 

ummmmm) 

ummmssk 

umLmwm^st 

ummmwm 


r  INOORSM  Remarks  on  above  questions,  if  deured  Question)  s ) 


PACT  V 

-  DjRROHfTlAlf  f  PQgMAI  Id  OP  tWMWT  PUTT 

(Read paragraph  4- 3f  AR  623-105) 

ratir  ano  moomh  In  my  judgment,  this  officer's  performance  of  duty  was  {place  score  tn  applicable  box) 

Outstanding 

Superior 

Excellent 

Effective 

Marginal 

Inadequate 

SCOW 

70- 6C 

67  -  57 

56-36 

35-15 

14-4 

3-0 

•ATM 

WT*. 

F — *1 

IMOOtSM 

85*353 

ry:  :  i 

♦  You  m*  required  to  cue  MICMC  e  sample  t  or  jJhjttrauoni  m  Pori  VII  lo  support  this  rating. 

DA  67-7  «w>asoAtow»K 


1  iAN  M.  WHICH  IS  OMOUTt 
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tATco  oman  last  mam  amd  ssn 


PM?  VI .  fOIMIML  (Read  <-i|.  623-103) 


*  *"**  *H0  if  i  had  full  responsibility  and  authority,  I  would  (place  score  in  applicable  box): 

P  remote  tkb 

fw—M  Om  fnmom  tkn  oOktrw  t*c  Fnu  Urn  tutmmaxtHm 

oOctr  «n  hO*  ydt  ah—rf  offlear  wM>  Ms  p^»talS»SI«« 

irTTintiTi'j  of  has  csMMpenam  mhw*h  I  Iinsy  manai 

scom  30  29-24  23-8  7-2 


*  You  arc  required  to  ette  SffOMC  tutnpkt  or  tlhmretiora  in  Part  VII  to  Mipport  Ihn  mini 


PAffT  Ml  -  COMMfNV*  (Read  paragraph  4-3h.  Al I  623-105) 


a.  KATf>  Sarralrve  evaluation  a  mandatory 


6.  IHOCNTSC*  Narrative  evaluation  it  mandatory  molest  the  provision*  of  paragraphs  2-2h  and  4-4#.  AR  623-105  apply. 


a.  SIGNATUM  Of  «Aff* 


PMTT  0  .  AimMWTICATION  (Read  paragraph  3-2).  AR  623-105 1 


(Last.  First ,  HI' 


GftAOt.  MAMCH.  OtGANIZATfON.  DUTY  ASSWNMMT 


»  SKJWATUtf  Of  MDORSC* 


GOA Of.  MAMCH.  ORGAMtf  ATK3N.  DUTY  ASS4GMMNT 


TVPfD  MAM  (L«M.  First.  HI) 


my  art**  □  indcatb  mo  putthm  action 


□  «f  SUITS  m  ACTIONS  STATfD  ON  INClOSURf  S 


H«+»J 

mR(2ha) 


ughatjh  os  tetewem 


GRADS,  MAMCH.  OfOAMUATIOM.  DUTY  ASSN3NMCMT 


TVPfO  NAM  (Last.  First.  HI) 


6  BAWD  OMCtR  COPY  (Check 
am  and  date) 

Q  I.  Grveu  to  aflkar 

D  2.  Forwarded  to  otlkar 

D  J  FnnmfrS  to  in  Sunn 
□  4.  ForetM  to  nMmi 


(Read  paragraph  J-H,  AR  623-103) 


c.  PORWAMNNG  AOOVtSS  (Rated  Officer) 


d.  OATK  RKflVtO 


e.  RATIO  omen  COPY 

□  I.  Qirraa  to  afloat 

□  2.  ForvwMd  »  atka 
Q  ).  Returned  to  MPO 
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